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ABSTRACT 

The Effective Schools Project is a test of a general 
method for improving organizational effectiveness. The 
method — Program Development Evaluation (PDE) — calls for 
researcher-practitioner collaboration in the design, implementation, 
and evaluation of programs to increase school effectiveness. Two 
Baltimore City junior high schools are working with Johns Hopkins 
researchers to reduce school disorder, increase attendance, and 
improve educational attainment. Both schools used the PDE method to 
design programs during 1982-83 and implemented them during 1983-84. 
The present evaluation shows that the schools are improving as a 
result of the project. Large and consistent increases were observed 
in staff morale, effective administration, and in teachers 1 reports 
of their schools as places where innovative planning and action 
occur. Findings also imply decreased school disruption and increased 
achievement. This report describes the projects, summarizes data on 
implementation, and recommends ways to facilitate the application of 
the PDE method in future projects. Appendices include profiles of 
school climate, non-Effective School Battery scales, teacher 
characteristics measures, and results for all program outcomes % 
(Author/LMO) 
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The Center 



The Center for Social Organization of Schools has two 
primary objectives: to develop a scientific knowledge of 
hov schools affect their students, and to use this knowledge 
to develop better school practices and organization. 

The Center works through three research programs to 
achieve its objectives. The School Organization Program 
investigates hov school and classroom organization affects 
student learning and other outcomes. Current studies focus 
on parental involvement, microcomputers, use of time in 
schools, cooperative learning, and other organizational fac- 
tors. The Education and Work Program examines the relation- 
ship between schooling and students" later-life occupational 
and educational success. Current projects include studies 
of the competencies required in the workplace, the sources 
of training and experience that lead to employment, college 
students" major field choices, and employment of urban 
minority youth. The Delinquency and School Environments 
Program researches the problem of crime, violence, vandal- 
ism, and disorder in schools and the role that schools play 
in delinquency. Ongoing studies address the need to develop 
a strong theory of delinquent behavior while examining 
school effects on delinquency and evaluating delinquency 
prevention programs in and outside of schools. 

The Center also supports a Fellowships in Education 
Research program that provides opportunities for talented 
young researchers to conduct and publish significant 
research and encourages the participation of women and 
minorities in research on education. 

This report, prepared by the Delinquency and School 
Environments Program, reports on a collaborative effort to 
improve two Baltimore City junior high schools. 
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Abstract 

The Effective Schools Project is a test of a general method for improving 
♦ organizational effectiveness. The method—Program Development Evaluation 

(PDE) — calls for researcher-practitioner collaboration in the design, imple- 
mentation, and evaluation of programs to increase school effectiveness. Two 
¥ Baltimore City junior high schools are working with Johns Hopkins researchers 

to reduce school disorder, increase attendance, and improve educational 
attainment. 

Both schools used the PDE method to design programs during 1982-83 and 
implemented them during 1983-84. The present evaluation shows that the 
school 8 are improving as a result: of the project. Large and consistent 
increases were observed in staff morale, effective administration, and in 
teachers' reports of their schools as places where innovative planning and 
action occur. Findings also imply decreased school disruption and increased 
achievement. 

This report describes the projects, summarizes data on implementation, 
and recommends ways to facilitate the application of the PDE method in future 
projects. 
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Many urban schools are troubled 
by low academic performance and high 
dropout rates* These problems are 
especially common in low income com- 
munities where poor student perfor- 
mance is often coupled with high 
levels of school disorder and delin- 
quent behavior (Gottfredson & Gott- 
fredson, in press)* Methods to help 
create beneficial and lasting 
changes in school practices are 
needed to reduce these problems. 
Despite accumulating research on 
educational technologies and 
advances in our understanding of 
ways schools might be more effec- 
tive, we lack useful and easily 
applied methods to help unless 
schools adopt and implement more 
effective arrangements. 

The Effective Schools Project 
is a test of a general method for 
improving organizational effective- 
ness* The method — Program Develop- 
ment Evaluation (G* Gottfredson, 
1984; Gottfredson, Rickert, Gott- 
fredson & Advani, 1984) — calls for 
researcher-practitioner collabora- 
tion in the design, implementation, 
and evaluation of programs to 
increase school effectiveness. Two 
Baltimore City junior high schools 
are working with Johns Hopkins 
researchers to reduce school 
disorder, increase attendance, and 
improve educational attainment* 
This report describes the programs 
that have been designed using the 
PDE method, reports on the level of 
implementation of the program compo- 
nents during the first of two years 
of operation, and presents early 
evaluation results. 



The Program Development Evaluation 
Method 

The PDE method has been 
described in detail elsewhere (Gott- 
fredson, 1984; Gottfredson, Rickert, 
Gottfredson & Advani, 1984*) Figure 
1 shows the steps in applying the 
method* Researchers collaborate 
with school personnel to define 
problems and set organizational 
goals, specify theories of action on 
which to base the school improvement 
program, define measurable objec- 
tives based on the theory, select 
interventions with a high likelihood 
of achieving these objectives, iden- 
tify and plan to overcome obstacles 
to the implementation of the inter- 
ventions selected, and develop 
detailed implementation standards to 
serve as blueprints for the inter- 
ventions* Educators and researchers 
work together to evaluate their pro- 
grams and use the resulting informa- 
tion to further improve the program. 
Planning and program development 
become part of the everyday routine 
in the school, creating a spiral of 
improvement • 

Assumptions 

The PDE method makes the fol- 
lowing assumptions about organiza- 
tional change: 

1. Projects guided by explicit theo- 
ries that can be translated into 
action will be most effective* 

2. Projects will be implemented with 
most enthusiasm, be strongest, 
and contribute most to knowledge 
of school improvement if the 
theory on which the project is 
based is regarded as sensible by 
project implemented and accords 
with evidence from previous 
research and evaluation. 
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Figure 1 

Tho Pro^rnin Development Evaluation Method 
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Source , iJott frodson , G. D. (1984). A theory-ridden approach to 
in'ouram oval uation. American P sychologist , 39, 1101-1112. 
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3. Effective implementation of an 
intervention or innovation is 
more likely if blueprints for the 
intervention are available and if 
implementation is guided by data 
about the extent to which project 
activities accord with the blue- 
print* 

4. Effective adoption of an innova- 
tion is more likely when explicit 
plans for adoption are available 
and when these plans are likely 
to overcome obstacles to organi- 
zational change* 

5* Projects will become more effec- 
tive in the presence of "evalua- 
tion pressure. 11 Evaluation pres- 
sure takes many forms, some of 
which are pressure to focus on 
theory, and to heed relevant 
information from previous 
research and evaluation and from 
current data about program 
strength, fidelity and effective- 
ness* 

6* Organizations that internalize 
these principles will be more 
effective than those that simply 
comply with them (Gottf redson, 
1984; pp. 1101-1102). 

The method is rational. It 
assumes that the effectiveness of 
organizations with clear goals will 
increase as rational behavior 
increases. The method explicitly 
rejects the expectation that schools 
must work as loosely coupled systems 
(Weick, 1984) using ad hoc manage- 
ment methods. Schools are fre- 
quently loosely coupled, but we 
assume that loose coupling often 
inhibits school effectiveness. The 
PDE method attempts to tighten man- 
agement by developing explicit stan- 
dards for performance, communicating 
these standards, assessing compli- 
ance or noncompliance with the stan- 
dards, and adjusting performance. 



Initiating the Project 

In Hay, 1982, researchers from 
the Center for Social Organization 
of Schools approached the Baltimore 
City Public School system to suggest 
a collaborative sciiool improvement 
project. At initial meetings with 
the Deputy Superintendent for Evalu- 
ation and Research and personnel 
from the Division of Pupil Services 
we discussed the PDE method and sug- 
gested a three-year project involv- 
ing two city junior high schools 
(Delinquency Program, 1982). The 
school system agreed to free up 
staff time for project activities 
and allow changes in job descrip- 
tions that would enable the develop- 
ment of a program without any addi- 
tional staff or other substantial 
costs* Johns Hopkins researchers 
committed their time and research 
resources to organisation develop- 
ment and evaluation using the PDE 
method. School system personnel 
selected two schools that were not 
targeted by other major projects > 
that were perceived as receptive to 
the kind of assistance that would be 
provided by the project, and whose 
key staff and student population 
were likely to remain stable for a 
three-year period— Calverton and 
Pimlico Junior High School 8. 

Principals of the schools were 
briefed on the project and asked to 
form working groups of key personnel 
from their schools. These working 
groups were to represent the major 
groups and departments in the school 
(i.e., guidance, administration, 
teaching)* Persons with leadership 
skills and whose jobs could be rede- 
fined to allow sufficient time for 
planning and implementing the proj- 
ects were to be selected* Each team 
consisted of one or two school 
administrators, one teacher, one or 
two guidance counselors, a school 
psychologist, and a social worker. 
One school also included a parent 
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liaison worker, and the other 
included a counselor from a commu- 
nity youth service agency and an 
educational specialist from a commu- 
nity planning organization. Person- 
nel from the central guidance ser- 
vices office and attendance services 
program also joined both groups. 

A two-day orientation session 
was held for the planning committees 
in October, 1982. Evidence about 
previous school improvement efforts 
was reviewed, and the groups 
received training in the PDE method. 
The planning process began at this 
orientation with a consideration of 
the schools' major problem areas* 

The planning groups met sepa- 
rately each month from October 
through June to plan comprehensive 
school improvement projects to be 
implemented the following year. The 
planning included specification of 
program goals, consideration and 
prioritization of major sources of 
the schools" problems, and specifi- 
cation of program objectives 
directed at the primary sources of 
the problems. Measures were devel- 
oped for every goal and objective 
and surveys were designed to assess 
progress towards these goals and 
objectives. In April, the planning 
teams administered surveys to all 
teachers and students in their 
schools to obtain baseline informa- 
tion for their evaluations and to 
provide information to be used to 
refine program plans. The surveys 
were based on the Effective School 
Battery (Gottf redson, 1985) but sup- 
plemented with items necessary to 
assess all goals and objectives. 

During this first planning year 
the Calverton Junior High School 
team oriented the entire school 
staff to the project and sought 
staff participation in subcommit- 
tees. The team decided to implement 
its program on a trial basis in the 



weventh grade unit only, and it 
recruited volunteer teachers to 
teach in the seventh-grade unit. 
They named their program Calverton 
Reaching for Excellence (CARE), and 
they planned a six-day training ses- 
sion for teachers and administrators 
in the seventh-grade unit to be held 
just before the opening of school 
the following Fall. 

During the first /ear the Pim- 
lico planning group determined its 
goals, elaborated several causes of 
the school's problems, and decided 
upon a name for their pro- 
gram — Building a Better Pimlico 
(BBP). It had difficulty, however, 
in prioritizing the causes of the 
problems and focusing on a workable 
number of program objectives. By 
the end of the school year it had 
not made a final decision about 
which of several possible interven- 
tions to implement during the 
1983-84 school year. High on the 
list of possibilities were the 
classroom instructional and manage- 
ment strategies that Calverton had 
planned, so the Pimlico committee 
took advantage of the training 
opportunity and recruited dome 
volunteer teachers to attend the 
Fall workshop with Calverton. 

The 1983-84 school year began 
with the six-day training workshop 
attended by 16 Calverton and 10 Pim- 
lico teachers, administrators from 
both schools, planning committee 
members, and central office person- 
nel. TV*o behavior management tech- 
niques — Assertive Discipline (Canter 
& Canter, 1976) and Reality Therapy 
(Glasser, 1969) — and an instruc- 
tional technique—Student Team 
Learning (Slavin, 1980) — were cov- 
ered. Survey results from the 
preceding Spring's survey were dis- 
cussed, and teachers from each 
school worked in groups to plan 
solutions to some of the most 
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pressing problems indicated by the 
surveys. Based on survey results, 
the Calverton group planned to form 
a Faculty Advisory group to open up 
lines of communication between 
faculty and administration. They 
also developed a plan to change the 
school's procedure for moving stu- 
dents to the c* eteri.s at lunchtime* 
The school's current procedure — one 
that had been established without 
teacher consultation — was bothersome 
to many teachers. Revising the 
procedure was important because it 
indicated to teachers that the 
administration was willing to accept 
teacher advice, and it gave teachers 
a renewed sense that they could make 
a difference in the how the school 
is run. The Pimlico group agreed 
that discipline was their highest 
priority problem and that a large 
source of the problem was lack of 
clarity about the school rules. 
They began work on a discipline 
policy for the school. 

The Calverton Program (CARE ) 

After the workshop, the Calver- 
ton gt ^up began a monthly process of 
monitoring each program component, 
comparing progress to the implemen- 
tation standards (Calverton Reaching 
for Excellence, 1983) that had been 
specified the year before, and 
revising the plan to increase feasi- 
bility. Calverton' s 1983-84 program 
is presented below. Following each 
program component's description is 
an account of progress made in that 
area during the 1983-84 year. 
Information about level of implemen- 
tation comes from monitoring records 
kept throughout the year and an 
implementation survey completed by 
11 of the 27 teachers participating 
in the program at the end of the 
school year. 



Career Exploration 

The objective of this component 
is to increase students' perceptions 
of the relevance of school to their 
lives. The Career Exploration com- 
ponent of CARE has three parts: 
Resource sessions expose students to 
positive community role models who 
have volunteered to inform students 
about the skills required to obtain 
and perform jobs in their fields. 
All students in the seventh grade 
unit were to experience one of these 
sessions per month, and the presen- 
tations were to be made to small 
groups of students (no more than 
three classrooms per session). The 
second part of the Career Explora- 
tion intervention called for 90% of 
the students in the seventh grade 
unit to go on a career-related field 
trip during the year. Finally, 
mini-course 8 covering the following 
topics were to be presented to stu- 
dents in their classrooms: 

Assessing vocational interests 
Using occupational information 
Developing individualized guid- 
ance plans 

Relating coursework to careers 
Improving self-presentation 
Clarifying values 
Improving decision-making 
skills 

Applying for jobs 
Preparing for summer work 

Guidance counselors were to present 
these lessons to students in their 
classrooms so that each classroom 
received one course per month. 

Career Exploration — Actual 
Implementation . Eight resource ses- 
sions were held, and most classes 
attended all eight. The sessions 
covered occupations in the following 
areas: skilled trades, personal and 
public services, health professions, 
transportation, professional and 
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semi-professional occupations, and 
military services. The field-trip 
subcomponent was less successful: 
Only seven of the twenty-one classes 
went on career-related field trips. 
Lack of transportation money made it 
impossible to meet the standard of 
one trip per class* Nine 'toini- 
courses" on career-related topics 
were to be presented to all class- 
rooms. Roughly 50% of the material 
to be covered in these courses was 
covered by the end of the year. 
Students were to learn about types 
of careers, to assess their own 
occupational aspirations and to 
research their aspired careers to 
learn about the necessary qualifica- 
tions and skills. These sessions 
were completed by all students 
except special education students, 
but the process was more taxing for 
the guidance counselor conducting 
the courses than expected. Activi- 
ties planned for the second semester 
were curtailed. The decision-making 
skills and values clarification 
courses were postponed until the 
next year, and sessions on the rele- 
vance of seventh grade subjects to 
careers, applying for jobs, and job 
market trends were cancelled. Only 
the individualized guidance plans, a 
part of the program that was man- 
dated by the central guidance 
office, was accomplished during the 
second semester. 

Parent Inform 

The objective of this interven- 
tion is to increase family members 4 ' 
support for their children's educa- 
tional activities. It seeks to keep 
parents and other family members 
informed about their children's pro- 
gress ir> school. All students in 
the seventh grade unit were to write 
a monthly letter to their families 
reporting their attendance and home- 
work assignment completion for each 
of their classes. The information 
for the letters would come from 



classroom charts which were to be 
updated daily. The letters would 
enable parents to monitor their 
children's progress and to request 
teacher conferences. 

Parent Inform—Actual Implemen- 
tation . Charts for recording home- 
work completion and attendance in 
the classroom proved cumbersome for 
many teachers, and even when the 
charts were maintained as planned, 
getting the information from the 
charts onto a letter for the parents 
and getting the letter home proved 
difficult because it required coor- 
dination across all of the students' 
classrooms,. Some teachers managed 
to send the letters home despite the 
logistical problems, but only 7 of 
the 11 teachers who completed the 
implementation survey reported that 
their classes sent letters home to 
their parents at least once. This 
component was substantially revised 
for the 1984-85 school year. 

Parent Volunteer 

The objective of this interven- 
tion, like Parent Inform, is to 
increase family members' support for 
their children's educational activi- 
ties. This component is designed to 
increase the involvement of the 
family members of students at risk 
of falling behind in or dropping out 
of school. The rationale is that as 
parents become more familiar with 
the school and more involved in 
school activities, the degree to 
which they value education and sup- 
port their children's educational 
activities will increase. 

According to the plan, the 
parent liaison worker would recruit 
parents to work as aides in the 
school and, with the help of teach- 
ers, would develop a tf job bank 11 
describing jobs to be done and 
skills required to do the jobs. A 
team composed of the parent liaison 
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worker, teacher volunteers, and 
parents would train the new parent 
volunteers before they were placed 

h in their jobs. Parents would be 

rewarded for their participation 
with certificates for completed 

i training, recognition at award cere- 

monies, and mention in a monthly 
flyer, a quarterly newsletter, and 
on the bulletin board. The stan- 
dards for Parent Volunteer called 
for at least thirty-five active 
volunteer workers in the school by 
the end of the school year. 

Parent Volunteer — Actual Imple- 
mentation . Twenty- seven parents 
worked in the school during the 

1983- 84 school year. One parent 
worked full-time, every day, and 
three others worked approximately 
50% time throughout the year. The 
other twenty-three parents were not 
as active: On average they worked 
about seven hours per month. The 
entire volunteer intervention added 
approximately 6.3 full-time equiva- 
lent workers to the Calverton staff. 

These workers were generally 
not well integrated into the school 
culture, however. Many of the 
volunteer hours were not used pro- 
ductively by the Calverton staff. 
Only three of the eleven teachers 
who answered the implementation sur- 
vey reported using a volunteer in 
his or her classroom. The component 
is being strengthened for the 

1984- 85 school year to include 
clearer statements of the volun- 
teers" duties, better training for 
teachers in ways to use parent 
volunteers, and more careful super- 

* vision of the volunteers as they 

work. 
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Community Support 

This intervention is designed 
to increase community support and 
advocacy for the school. It has 
three parts: The first' seeks to 
increase the base of community sup- 
port for Calverton by using the 
media, a newsletter, and meetings to 
make the community more aware of the 
school and its needs* The second 
component seeks to stimulate job 
opportunities for Calverton stu- 
dents. The third component, called 
n Adopt-a-School, n seeks to identify 
resources in the community that can 
be put to use at Calverton. 

One piece of "Adopt-a-School 11 
is the College Intern intervention, 
which places student interns from 
local colleges at Calverton. These 
interns assist in publishing news- 
letters, tutoring or counseling stu- 
dents, monitoring the cafeteria, 
organizing cultural enrichment 
activities, and collecting and tabu- 
lating data for the evaluation of 
project CARE* They also offer gen- 
eral assistance in classrooms, the 
library and the school offices. 

Community Support — Actual 
Implementation * Only the College 
Intern segment of this intervention 
was implemented during the 1983-84 
school year. Each of four college 
interns worked with teachers in 
their classrooms for twelve hours 
during the 1983-84 school year* 

A committee of school personnel 
worked on plans for the rest of the 
intervention to be implemented in 
the 1984-85 year. 

Classroom Management Innovations 

These innovations were directed 
at decreasing classroom disruption 
by establishing clear and fair 
rules, by enforcing the rules con- 
sistently, and by increasing 
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students' decis ion-making and con- 
flict resolution skills. Two class- 
room management techniques— Asser- 
tive Discipline (Canter & Canter, 
1976) and Reality Therapy (Glasser, 
1969)— were to be used in the proj- 
ect CARE classrooms. The techniques 
use complementary approaches and are 
intended to promote a calm, orderly 
classroom atmosphere. 

Assertive Discipline stresses 
preplanning, taking initiative, and 
setting direction. It (a) sets 
clear, consistent limits and speci- 
fies consequences for students; 
(b) provides uniform follow-through; 
and (c) offers students warmth, sup- 
port and rewards for appropriate 
behavior. 

Reality Therapy also stresses 
clear rules and consistent applica- 
tion of consequences, but it places 
more emphasis oa getting the student 
to make a commitment to change his 
or her behavior* By increasing stu- 
dent-teacher interaction and posi- 
tive involvements with others, Real- 
ity Therapy is expected to foster in 
students a stake in conformity. In 
addition, Reality Therapy helps the 
teacher guide students through a 
rational thought process that helps 
them see the futility of misbehavior 
and choose a different course of 
action. 

Both techniques help the 
teacher focus on student behav- 
iors — to reduce undesirable behav- 
iors and substitute desirable behav- 
iors. Both techniques assign stu- 
* dents the responsibility for their 
actions: Assertive Discipline by 
making explicit that students choose 
negative or positive consequences by 
their actions, and Reality Therapy 
by training students to engage in a 
rational decision-making process to 
develop a plan of action. 



A peer support network was 
planned to help teachers apply 
Assertive Discipline and Reality 
Therapy techniques in their class- 
rooms. CARE teachers were to visit 
each others' classrooms weekly to 
observe and monitor implementation. 
A standardized observation booklet 
was created for this purpose. The 
observation data were to be used to 
structure biweekly cluster meeting 
discussions focused on resolving 
implementation difficulties. (The 
grade units at Calverton are subdi- 
vided into clusters of classrooms 
such that each cluster contains one 
teacher from each of the major sub- 
ject areas. Each teacher teaches 
only student 8 in his or her cluster, 
and the clusters of teachers are 
encouraged to work together as a 
team.) 

Classroom Management Innova- 
tions — Actual Implementation . This 
area was partially implemented dur- 
ing the 1983-84 school year. All 
but one of the 27 seventh grade 
teachers received training in Real- 
ity Therapy, and 16 received the 
Assertive Discipline training. The 
16 teachers who attended the August 
workshop developed a set of uniform 
classroom rules and consequences. 
These were posted in every class- 
room. Some teachers successfully 
applied the Assertive Discipline 
techniques, and some tried but gave 
up after initial failure. We do not 
know exactly how many teachers used 
the technique during the 83-84 year. 

Reality Therapy's classroom 
meetings were used by at least seven 
of the 11 teachers who completed the 
implementation survey — they reported 
using the technique with a total of 
nine different classrooms. Of the 
seven, five held frequent meet- 
ings—between 12 and 84 meetings for 
the year. The average number of 
meetings per class was 10. We do 
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not know if Glasser's (1974) 
"ten-steps" were used. The planning 
committee decided to deemphasize 
this strategy in favor of the Asser- 
tive Discipline approach for the 
following year. 

The peer support network was 
not established. Instead, a 
researcher observed classrooms once 
during the year and provided feed- 
back to teachers about their perfor- 
mance at that time. 

Classroom Instructional Innovations 

The objective of these innova- 
tions is to decrease negative peer 
pressure, increase motivation to 
achieve, improve academic self-con- 
cept, and increase positive partici- 
pation in the classroom. Student 
Team Learning (STL; Slavin, 1980) 
techniques were to be used on an 
ongoing basis in all seventh grade 
classrooms. These teaching strate- 
gies were to be integrated with the 
Kastery Learning (Block & Anderson, 
1975) strategies that the teachers 
were learning as part of a city-wide 
initiative. Mastery Learning and 
Student Tesm Learning structure dif- 
ferent components of the learning 
process to increase learning* Mas- 
tery Learning allows the student 
ample time to master the curriculum 
materials before proceeding to the - 
next instructional objective. The 
Student Team Learning Tech- 
niques — Teams-Games- Tournament , Stu- 
dent Teams/Achievement Divisions, 
and Jigsaw II motivate students to 
learn academic material by estab- 
lishing competitions for team reward 
or recognition. Teams are composed 
of four or five students of differ- 
ing ability. The team members study 
together and coach one another in 
preparation for class-wide tourna- 
ments or individual tests. Points 
are awarded to teams on the basis of 
their members' improvement over 



their own past performance or on the 
basis of their performance in a 
tournament in which students compete 
against individuals of similar abil- 
ity levels. 

The same peer support network 
described above under the classroom 
management innovations was to pro- 
vide information and implementation 
assistance to teachers as they 
implemented these new techniques. 

Classroom Instructional Innova- 
tions — Actual Implementation . All 
teachers in the seventh grade unit 
received training in STL. At least 
19 of the 27 teachers used STL dur- 
ing the year. These 19 consented to 
an observation by the research 
scientist working with the project, 
and 13 were actually observed. Of 
the 11 teachers who completed an 
implementation survey at the end of 
the year, eight reported having used 
STL, and five were frequent users. 
These surveys and observations tell 
us that at least 16 of the 21 sev- 
enth grade classrooms were exposed 
to STL. The intensity of STL use 
varied from classroom to classroom. 
One class used the techniques for 
only four lessons during the year, 
others for as many as 51. Of those 
classrooms using STL, the average 
number of lessons was 30, according 
to the implementation surveys. 

Extracurricular Activities 

These activities are directed 
at increasing students' attachment 
to school, sense of school pride, 
and the extent to which students are 
rewarded for nonacademic accomplish- 
ments. They were designed to 
.involve students — especially stu- 
dents who do not typically partici- 
pate in school activities — in a wide 
array of extracurricular activities. 
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A student survey was to be 
administered in early Fall to deter- 
mine which activities would be of 
interest to students. Faculty and 
staff volunteers were to be 
recruited to help student teams 
organize clubs and implement the 
activities. Each club would appoint 
a representative to a committee 
responsible for publicizing every 
activity. At least 50% of the stu- 
dents in the unit and 70Z of the 
special education students were to 
participate in at least one extra- 
curricular activity during the year. 

Extracurricular Activities — Ac- 
tual Implementation . The faculty 
member in charge of this component 
surveyed all students and school 
staff in October, 1983. Students 
expressed an interest in fifteen 
different clubs, and thirteen of 
these were established. We docu- 
mented that six of them actually 
met, involving 165 students. Nine 
more clubs that were requested at a 
later date or were requested by 
school staff were also established, 
involving 223 students. We do not 
know how close we came to meeting 
our standard of 50% of the seventh 
grade students and 70Z of the spe- 
cial education students participat- 
ing in these activities because 
individual records of attendance 
were not kept. We do know that sev- 
enth graders were overrepresented 
among the participants, and we esti- 
mated that nearly half of them par- 
ticipated at least once during the 
year. 

Sehnnl Dis cipline Review and Revi- 
sion 

The objective of this component 
is to increase consistency of rule 
enforcement and the extent to which 
students believe in the school 
rules. An underlying principle 
which guides the CARE approach to 



discipline in the classroom and in 
the school is that teachers are 
responsible for the management of 
their classrooms. The intervention 
seeks to provide teachers with the 
skills, information, and support 
they need to become successful 
classroom managers and to limit 
unit-level disciplinary action to 
major disciplinary problems. 

School rules, consequences for 
breaking school rules, and a disci- 
plinary referral system were to be 
established. All teachers in the 
seventh grade unit were to use the 
discipline referral system as 
intended, and the administrators in 
the school were to follow through 
consistently with the consequences 
specified in the discipline guide. 

School Discipline Review and 
Revision — Actual Implementation . 
Committee members produced a disci- 
pline guide and a discipline refer- 
ral form, and they established' 
procedures for referring students to 
the office. The guide was reviewed 
with all teachers. The referral 
forms and procedures were used 
school-wide. One thousand eighty- 
seven referrals were made during the 
year. All but four of the 87 teach- 
ers in the school used the form for 
at least one referral during the 
year. The range of referrals was 
from 0 to 80, and the mean number of 
referrals was 12. This average is 
misleading because a few teachers 
referred an unusually large number 
of students to the office. The 
modal number of referrals was one, 
and only eight teachers made more 
than 30 referrals during the year. 
We know that the referral forms were 
not used for all rule infractions in 
the school because there were 715 
disciplinary removals for which no 
referral form was filed. Many of 
these were probably violations that 
occurred in hallways or other common 
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areas, but some were probably 
incidents that should have been 
referred to the office according to 
the procedures in the guide* 

Data from the analysis of the 
referral forms indicated that indi- 
vidual administrators were applying 
the standard consequences for rule 
infractions to different extents* 
For example, despite rough equiva- 
lence across units of types of 
infractions referred to the office, 
one administrator sent a much larger 
percentage of referred students home 
than did other administrators* 
These differences were not resolved 
during the first year of program 
implementation. 

The Pimlico Proiect~BBP 

During the summer of 1983 a new 
principal and two new assistant 
principals came to Pimlico, and we 
were told that Pimlico Junior High 
School was to become Pimlico Middle 
school in the Fall of 1984. We met 
once with the new principal to 
explain the project and the progress 
to date. We discussed possible rea- 
sons for the slow progress during 
the previous year* The new princi- 
pal supported the program, and she 
worked with us to narrow down the 
interventions and group them into 
categories for easy presentation* 
She assigned three new team members 
with leadership skills to the team* 

The first meeting of the 
enlarged team was not successful. 
The group was large and our brief 
presentation of the PDE process, the 
history of the project, and the 
goals for the year provided an 
inadequate orientation* People were 
confused about the project, how it 
related to their other duties, and 
the role of the Hopkins researchers. 
After this meeting two of the new 
committee members chose not to con- 
tinue with the project, and the 



principal requested a cutback in 
meeting time. 

Under the new arrangements, 
subcommittees were to meet one 
half-day per month rather than the 
full committee for one day per 
month. The discipline subcommittee, 
the first to meet, worked on plans 
to implement a specific discipline 
review component and presented them 
to the principal for approval. At 
that time, discrepancies between the 
philosophy on which the previous 
year's plans were based and the phi- 
losophy of the new principal became 
apparent. 

By December, 1983, it was 
apparent that the new planning 
arrangements were not effective. A 
meeting with the principal to dis- 
cuss roadblocks to effectiveness 
resulted in the principal becoming a 
more integral part of the planning 
process and allocating more staff 
time to the project. By that time 
she was more familiar with her 
faculty and was able to appoint four 
strong members to the team. 

This was a turning point for 
the Pimlico project. The interven- 
tions recommended during the 82-83 
year, and the objectives and theory 
underlying each, were reexamined. 
Some interventions were eliminated 
and the remaining ones were 
strengthened. Implementation stan- 
dards were established, and obsta- 
cles to implementation were 
assessed. The newly composed team 
zeroed in cn implementation diffi- 
culties in the school. It analyzed 
the reasons for lack of support for 
project activities and designed 
activities aimed at gaining support. 
The team planned and executed a 
series of staff briefings followed 
by a survey of all teachers to 
ascertain the success of the brief- 
ing effort. Only 54% of the staff 
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responded to the survey, but all of 
those reported that they could 
explain the project goals to an out- 
sider, and between 84 and 97% 
reported that they could describe ■ 
the various components of the proj- 
ect. 

Progress on specific program 
components was slow during the 83-84 
school year because the committee 
had to focus much of its resources 
on creating a structure in the 
school that would facilitate program 
implementation during the following 
year. A more effective structure 
was needed to move the program for- 
ward. The team oriented the staff 
to the project (as described above) 
and designed structures to enhance 
communication and teamwork. Much 
effort would have been saved if the 
original team had resembled the 
revised team more closely, and if 
there had been sufficient time to 
work with the new principal before 
the school year began to better 
integrate the project into her plans 
for the school. This integration 
proceeded at a slow pace, and was 
not complete until the end of the 
1983-84 school year. 

The BBP project planned during 
\ 982-83 was modified considerably 
during the 1983 -84 school year as we 
workec with the new school adminis- 
tration to coordinate the BBP plans 
with those of the principal. The 
following pages describe the initial 
plan for BBP. This program was, for 
the most part, not implemented dur- 
ing the 83-84 school year. Excep- 
tions are described following each 
component description. 

Student Affective Interventions 

This set of activities has sev- 
eral objectives: (a) Improve stu- 
dents' and public's perception that 
Pimlico is a safe school to attend; 



(b) increase the degree to which 
students are rewarded for positive 
behavior; (c) increase positive 
attachments to teachers and peers; 
and (d) improve students' conflict 
resolution skills* There were three 
major activities planned in this 
area: A school safety campaign, 
attendance interventions, and peer 
counseling. 

School Safety Campaign . This 
campaign sought to (a) teach alter- 
natives to fighting; (b) increase 
the clarity and consistency of 
school rules, by a re-evaluating the 
disciplinary structure and piloting 
effective classroom management stra- 
tegies; and (c) gain media coverage 
of Pimlico's efforts to improve its 
climate. 

School Safety Campaign — Actual 
Implementation . A discipline guide 
was produced. This guide stated 
school rules and consequences for 
breaking the rules, and it clarified 
the procedure teachers and adminis- 
trators wouLd use in dealing with 
behavior problems. The guide was 
given to teachers and reviewed with 
them. Classroom rules and conse- 
quences for breaking them were 
posted in every classroom. A disci- 
plinary referral form was designed 
and teachers were told how to use 
the form. Sixty-one of the 78 
teachers used the referral system to 
make at least one referral* Of 
those who used the form, the modal 
number of referrals was one for the 
year, and the average number was 14. 
A few teachers made large numbers of 
referrals (as many as 109), but 92% 
of the teachers made fewer than 30 
referrals and 80% made fewer than 20 
referrals. 

An effort to expand the variety 
of disciplinary options in the 
school was unsuccessful. The in- 
school suspension center planned by 
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the discipline committee was never 
opened because the principal felt 
that it could not be staffed 
(options for staffing were not tho- 
roughly explored by the committee 
because the principal also discour- 
aged the idea of the center). 
Teacher 8 were asked to use indivi- 
dual discipline recording forms to 
monitor their reactions to misbehav- 
ior in the classroom, but the pur- 
pose of the form was not made clear 
to the teachers until the end of the 
school year and the use of the forms 
was not monitored. The use of these 
forms was limited— even teachers on 
the planning committee did not use 
them. Plans to provide feedback and 
assistance to teachers who used only 
a narrow range of consequences were 
never carried out • 

Attandance Interventions * Pre- 
liminary plans included two atten- 
dance-related interventions. 

(a) Competitions among clusters 
(groups of students who travel from 
class to class together sharing the 
same set of teachers) for awards for 
the best overall attendance and the 
"most improved 11 attendance, and 

(b) student attendance teams with a 
rotating team leader responsible for 
calling other team members every 
evening to encourage attendance. 

Attendance Interventions — Ac- 
tual Imp lemen t at ion . The planned 
attendance interventions were not 
implemented. Instead, students with 
perfect attendance received quar- 
terly certificates. 

Peer Counseling . The Baltimore 
City Public Schools guide, "Peer 
Counseling in the Guidance Program," 
was to be the model for a peer faci- 
litator intervention. This inter- 
vention would focus on improving 
conflict resolution skills and coun- 
seling students experiencing diffi- 
culties. 



Peer Counseling — Actual 
Implementation . Ten students were 
selected to become peer counselors 
and eight of these completed ten 
training sessions, or half of the 
training. No counseling was done. 

Teacher Morale and Competency Build- 
ing 

The objectives for this set of 
activities are to increase teacher 
morale, commitment, and knowledge 
and use of sound teaching and class- 
room management techniques. Gener- 
ally, this program component was to 
facilitate communication and the 
spread of ideas; to recognize out- 
standing professional contributions; 
and to create a framework for 
assistance, collaboration, and 
friendly social interaction among 
members of the staff. The specific 
teaching and classroom management 
techniques targeted were 
(a) increase the degree to which 
teachers reward students for posi- 
tive behavior, (b) increase degree 
of "critical thinking" as opposed to 
"giving correct responses" among 
students, (c) improve teacher-stu- 
dent interaction in the classroom, 

(d) increase the proportion of stu- 
dents for whom the level of instruc- 
tion is appropriate, and 

(e) decrease classroom disturbances. 
Staff development would be needed to 
help teachers do these activities. 

Social Club . A "Pimlico Social 
Club" was to to increase teachers' 
sense of belonging to a team. 

Social Club — Actual Implementa- 
tion . Five social activities were 
planned. One was not held. Another 
was attended by only three or four 
people. A Christmas party and a 
potluck luncheon held at the school 
were both well-attended, and an 
off-campus picnic was attended by 
about thirty people. 
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Staff Development . The general 
staff development plan was to expose 
all teachers to each innovation, 
then to work intensively with a sub- 
set to ensure quality implementa- 
tion. The first subset of teachers 
who receive intensive assistance 
were to assist with the follow-up 
activities for the next group, and 
so on. 

The specific techniques or 
skills to be included in the staff 
development activities were: 

1. Reality Therapy (see previous 
description) , 

2. Student Team Learning (STL) 
(see previous description), 

3. Classroom grouping strategies, 

4. Questioning skills, and 

5. Skill at relating different 
subject areas to one another* 

Staff Development — Actual 
Implementation * Ten teachers 
received training in Reality Ther- 
apy, Assertive Discipline and Stu- 
dent Team Learning at the August 
1983 workshop. We do not know to 
what extent the techniques were 
implemented by these teachers 
because activities aimed at orient- 
ing the staff to the project took 
priority over monitoring the class- 
rooms of the teachers • Flans to 
extend these techniques to other 
teachers in the school and to con- 
trol the quality of the implementa- 
tion effort were made during the 
1983-84 year. 

All teachers were trained in 
Reality Therapy in a one and one- 
half day workshop in January, 1984. 
Implementation monitoring showed 
that the teachers were not imple- 
menting the techniques as planned. 
Progress was slowed while the 



planning committee turned its atten- 
tion to resolving basic problems of 
lack of teacher involvement in the 
planning for the project and staff 
lack of understanding about the 
project. Plans for complete imple- 
mentation of the Reality Therapy 
techniques were made for the follow- 
ing school year. 

Community Support 

The objectives of this compo- 
nent are to (a) increase community 
support and advocacy for the school, 
and (b) increase the level of social 
control of truancy by the surround- 
ing community. BBP planned to: 

1. Invite local business persons to 
talk to small groups about the 
importance of school attendance; 

2. Encourage local stores to offer 
"give-aways" as rewards for 
improved attendance or to post 
lists of names of students whose 
attendance improved; 

3. Seek the help of community groups 
in identifying truants; and 

4. Invite churches to hold inter- 
church school attendance pro- 
grams. 

Community Support — Actual 
Implementation . None of the planned 
activities in this area were carried 
out. Instead, a "Meet the Princi- 
pal" night was held in September tc 
introduce the community to the BBP 
project. A committee of 12 repre- 
sentatives from interested community 
organizations was formed. This 
group met monthly from November 
through June. About eight of the 12 
members attended the meeting regu- 
larly. The group planned and car- 
ried out another "Meet the Princi- 
pal" meeting in April to discuss the 
conversion of the school to a middle 
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school. This meeting was 
well-attended. The group also soli- 
cited donations from local busi- 

* nesses to be used to reward students 
for good behavior, attendance, and 
achievement. We have not documented 

* the extent to which this effort suc- 
ceeded . 

Interim Evaluation of Program Out- 
comes 

Measures 

The primary evaluation instru- 
ment for the Effective Schools Proj- 
ect (ESP) is a set of surveys admin- 
istered to all teachers and students 
in both schools in April of each 
year. Additional measures are taken 
from school records. The basis of 
the surveys is the Effective School 
Battery (ESB) Teacher Survey and 
Student Survey (Gottf redson, 1985). 
The ESB Student Survey was modified 
for the present project. It pro- 
vides measures of most of the ESP 
goals and objectives, but for some 
we had to add items from other sur- 
veys or develop our own measures. 
We deleted some of the ESB scales to 
ensure that the survey could be com- 
pleted in a two-hour period. 
Details of the scale construction 
and psychometric properties of the 
Effective School Battery scales are 
included in the ESB manual. Appen- 
dix B contains information about the 
non-ESB scales. 

Evaluation Design 

The design called for compari- 
sons of gain scores for each of the 
program schools from one year to the 
next with gain scores for two other 
junior high schools that were 

* closely matched to the project 
schools on racial composition and 
enrollment. Table 1 shows demo- 
graphic characteristics of the proj- 
ect and comparison schools. 



Unfortunately, the absence of a 
specific prior agreement about the 
evaluation requirements resulted in 
the school system's decision to 
forego the survey administration in 
the comparison schools. The Deputy 
Superintendent of Planning, 
Research, and Evaluation could not 
justify the disruption and extra 
work entailed in administering sur- 
veys to students who were not in the 
program schools. For all outcomes 
measured by the survey we will com- 
pare each project school to its own 
baseline • 

An additional comparison is 
made possible by the design of Cal- 
vert on' s program. Because the com- 
mittee chose to intervene in the 
seventh grade only, we are able to 
compare the Spring, 1984 measures 
for the experimental seventh grade 
to Spring, 1983 measures for the 
preceding cohort of seventh graders. 
Similarly, 1985 measures of the 
1983-84 seventh grade cohort (which 
will then be in the eighth grade) 
will be compared with the preceding 
two years' cohorts of eighth grad- 
ers. For all Effective School Bat- 
tery measures we report pre and post 
percentile ranks for the schools 
with respect to approximately 70 
secondary schools in predominantly 
inner-city, minority schools which 
administered the ESB between 1981 
and 1983. 

Differences between the experi- 
mental cohort and the nonexperimen- 
tal cohort may arise from factors 
other than the treatment. Times 
change. To the extent that cohorts 
of youths are affected by changes in 
their environments, the comparison 
of experimental and nonexperimental 
cohorts will reflect these differ- 
ences rather than or in addition to 
differences attributable to the pro- 
gram. Also, each cohort of students 
has a different unit administrator. 
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Table 1 



Pretreatmint Data for Effective Schools Project 
Schools and Two Comparison Schools 



Calver ton 



Lemmel a 



Pimlico 



Greenspringa 



Enrollment 



1981 
1982 
1983 



Attendance Rate 1981 
1982 
1983 

Mean Grade Equivalent 
California Achievement 
Test in Reading 



Grade 7 



Grade 8 



Grade 9 



1981 
1982 
1983 

1981 
1982 
1983 

1981 
1982 
1983 



1395 
1357 
1488 

7 9% 
80% 
77% 



6 .4 

6 .2 
6.3 

7 .9 
8.1 
8.0 

8.1 
8.2 
8.7 



1276 
1437 
1344 

81* 
8 i% 
76% 



6.2 
6.2 
6.4 

7.6 
7.8 
7.9 

8.1 
8.5 
8.5 



1722 
1483 
1425 

83% 
82% 
7 9% 



6.4 
6.3 
6.4 

7.9 
8.0 
8.0 

8.5 
8.7 
8.3 



1746 
1617 
1468 

81% 
76% 
77% 



6.3 
6.1 
6 .4 

7.3 
8.3 
8.0 

8.4 
8.4 
8.5 



Note . All schools have approximately 100% black student population, 
a. 



Comparison school. 
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Table 2 



Pre-Project Means and Standard Deviations on Teacher 
Characteristics and Behaviors for Experimental and 
Nonexperimental Teachers — Fall, 1983 



Experimental Nonexperimental 

Behavior/Characteristic ~~ " " 

M SD N M SD N 



Structured Teaching Style 


3.38 


.55 


15 


3.34 


.67 


26 


Vocabulary 


.35 


.23 


14 


.39 


.25 


26 


Have used (proportion) 














Student Team Learning 


.79 


.42 


14 


.76 


.44 


29 


Assertive Discipline 


.79 


.42 


14 


.80 


.41 


25 


Reality Therapy 


.39 


.51 


13 


.38 


.49 


24 


Mastery Learning 


.96 


.25 


16 


.97 


.19 


28 



Notes No difference between experimental and nonexperimental 
teachers is significantly different from aero. 
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To the extent that the administrator 
affects the educational climate in 
the unit, the comparison of experi- 
mental to nonexperimental units will 
reflect these differences. The 
final analysis of program effective- 
ness will include a comparison of 
each cohort's growth over its own 
baseline. Greater improvement for 
the experimental unit would add to 
evidence of program effectiveness. 

The comparison of experimental 
with nonexperimental teachers at 
Calverton is more problematical 
because 19 of the 27 experimental 
teacher 8 volunteered or were 
selected by the principal to parti- 
cipate in the program. It is possi- 
ble that experimental teachers and 
nonexperimental teachers were dif- 
ferent before they were exposed to 
the program* We examined teacher 
evaluation ratings made by princi- 
pals at the end of the the 1982-83 
school year. The average rating for 
CARE teachers was 50.9 (SD*23 .3) and 
for other teachers it was 47.7 
(SD-20.8), a non-significant differ- 
ence. However, we have no evidence 
that the teacher evaluation is a 
valid indicator of any teacher qual- 
ity that is of interest to this 
study, and we were able to obtain 
ratings for only 72 and 61% of the 
treatment and control teacher 
groups, respectively* 

A second source of information 
about experimental and nonexperimen- 
tal teacher pre-intervention differ- 
ences at Calverton comes from a sur- 
vey completed by teachers during the 
first faculty meeting in Fall 1982. 
This survey was intended to measure 
teacher characteristics and behav- 
iors related to project outcomes and 
to level of implementation of the 
program* Appendix C describes the 
measures used from this survey* If 
the experimental teachers differed 
on these dimensions prior to treat- 



ment, we would have more reason to 
believe that post-treatment differ- 
ences would be due at least in part 
to the particular teachers selected 
for the program rather than to the 
program itself. Table 2 shows that 
the experimental and nonexperimental 
teachers did not differ on vocabu- 
lary or teacher structuredness, two 
measures which, according to prior 
research (Program on Teaching Effec- 
tiveness, 1978), differentiate 
teachers on implementation success* 
The hard evidence we have about pre- 
treatment differences between the 
experimental groups, then, suggests 
that the Calverton teacher groups 
were similar on those characteris- 
tics that would most likely lead to 
differences in the outcomes of the 
study. Softer evidence also sup- 
ports this suggestion: The princi- 
pal of the school believes that the 
groups were similar before the pro- 
gram started. 

Results 

We do not expect to see big 
differences on the measures of the 
long-term goals of the ESP schools 
after one year of partial implemen- 
tation. The purpose of this initial 
outcome evaluation is to check our 
progress in those areas that were 
sufficiently implemented to be 
expected to have made a difference 
during the first year* Results for 
all outcome measures appear in 
Appendix D, The following section 
highlights resulus for the few pro- 
gram components that were imple- 
mented. 

Student Outcomes 

Student Behavior . Many of the 
program components targeted student 
behavior* The ones that would be 
expected to have their largest and 
most direct effect on student behav- 
ior are the school-wide discipline 
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revisions put in place in both 
schools, and the two behavior man* 
agement techniques, Reality Therapy 
and Assertive Discipline* If the 
latter two were implemented strongly 
enough to make a difference, ve 
would expect to see the largest 
behavior changes in Calverton's sev- 
enth grade unit, where trained 
teachers were clustered and where 
teachers were most encouraged to use 
the techniques* The evidence shows 
that student behavior did not 
improve very much in Calverton's 
seventh grade unit, at least accord- 
ing to students* Student reports of 
Delinquency, suspensions, and Rebel- 
lious Autonomy (an attitude that the 
student can do whatever he or she 
wants and that what other people 
think doesn't matter) were e lightly 
lower but their reports of rebelli- 
ous behavior in the classroom were 
slightly higher than th* previous 
year's seventh grade* The teachers' 
reports indicate that the behavior 
management strategies had a small 
positive effect on classroom order, 
however* Teachers' reports of 
classroom order in the experimental 
unit at Calverton were at the 24th 
percentile while all other teachers' 
reports were at the 9th percentile* 

Students at Calverton in gen- 
eral reported significantly less 
delinquent behavior in 1984 ttun in 
1983, but the decline is due mainly 
to the 1983 8th grade reporting sig- 
nificantly less delinquent behavior 
than the previous year's 8th grade* 
Students' reports of their own 
behavior do not show an improvement 
at Pimlico; instead, the data show a 
statistically significant increase 
in drug use* Teachers at both 
schools, however, reported increases 
in Classroom Order— Pimlico from the 
9th to the 16th percentile and Cal- 
verton from the 4th to the 12th per- 
centile* Neither of these differ- 
ences was statistically significant* 



Although students did not 
report improved behavior, students 
and teachers at both schools 
reported that their schools were 
safer at the end of the first year 
of the program than they were the 
previous year* The differences in 
the teacher reports are highly sig- 
nificant* 

To summarize, the data on 
delinquency and disruption outcomes 
show both schools have become safer 
places, and that teachers in both 
schools reported more orderly class- 
rooms (although the differences were 
not large)* The increase in Class- 
room Orderliness was most marked in 
Calverton's experimental unit* Stu- 
dent self-reports of misconduct, 
however, diverge from this general 
picture* 

Increasing the clarity of rules 
and the consistency of rule enforce- 
ment may have increased safety at 
both schools* Pimlico and Calverton 
both developed and disseminated dis- 
cipline guides, instituted disci- 
plinary referral systems and posted 
classroom rules* Consistent with 
this explanation, we would expect to 
see an increase in student reports 
of Clarity of Rules in both schools* 
Both schools did increase: Calver- 
ton from the 89th to the 91st per- 
centile and Pimlico from the 78th to 
the 92nd percentile* Neither of 
these differences is large or sta- 
tistically significant, but both 
schools were high on this dimension 
to begin with* It is unlikely that 
these relatively small increases in 
perceptions of Rule Clarity would 
lead to such large increases in 
school Safety* Pimlico placed post- 
ers dealing with school safety 
around the school, and at Calverton 
increased perceptions of Safety may 
have resulted from improved class- 
room management* Factors unrelated 
to the project may also have 
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resulted in reports of increased 
Safety in the schools. 

Academic achievement . It is 
premature to expect a noticeable 
increase in academic achievement at 
either school. Most of the program 
components at both schools are 
directed at changing students" atti- 
tudes about school — increasing their 
motivation to attend school and to 
learn. The intervention most likely 
to have a direct and fairly immedi- 
ate influence on academic achieve- 
ment is Student Team Learning. We 
have no evidence about the extent to 
which the ten Pimlico teachers who 
were trained in these techniques 
actually used them, but we know that 
most of Calverton' s experimental 
teachers used the techniques at 
least once, and that most of the 
students in the unit were exposed to 
them. At least five of the experi- 
mental teachers used the techniques 
regularly. Hence we would expect to 
see the largest improvement in 
achievement among Calverton seventh 
grade students, but ve do not expect 
a large jump even there because the 
program was only partially imple- 
mented. {The research demonstrating 
the effectiveness of this technique 
typically involves continuous use 
for a period of at least six weeks 
(Slavin, 1983)}. All grade levels 
in both schools improved slightly on 
the California Achievement Test. 
Calverton' s seventh grade did not 
fare better than any other grade on 
these tests. On measures of grades 
and promotion, the seventh grade 
unit at Calverton looks worse than 
the eighth and ninth grades, but 
this is because each year the low- 
est-achieving students drop out of 
school, raising the average achieve- 
ment levels of the remaining stu- 
dents. Seventy-five, eighty, and 
ninety-one percent of the seventh, 
eighth and ninth grades, respec- 
tively, were promoted to the next 



grade, but the number of students in 
each grade level tells us something 
about the extent tc which dropout is 
affecting the improvement in aca- 
demic achievement: The seventh 
grade had 628 students, the eighth 
had 557 and the ninth had 429 stu- 
dents. A more relevant comparison 
is that between the percentage of 
previous year's seventh graders and 
the experimental seventh grade's 
promotion rates. Only 62% of the 
previous year's seventh grade was 
promoted to the eighth grade, as 
compared to 75% of the experimental 
seventh grade. 

Student Team Learning tech- 
niques provide rewards in the form 
of peer acceptance and recognition 
for academic achievement. If the 
technique is working we would expect 
students to report increased rewards 
for academic performance* Indeed, 
students in both schools reported 
receiving significantly more rewards 
in school after one year of treat- 
ment. Calverton went from the 27th 
to the 42nd percentile overall, and 
the CARE unit increased to the 54th 
percentile — a highly significant 
increase. Pimlico went from the 
2l8t to the 58th percentile. Pimli- 
co's large increase suggests that 
the STL techniques were used more 
than we know. It is also possible 
that the score was raised by the 
increase in rewards for attendance 
and good behavior that were part of 
other interventions. We have no 
hard data on the extensiveness of 
these interventions. 

Student Attitudes . Student 
attitudes were a third major area 
targeted for improvement. The 
extracurricular activities at Cal- 
verton aimed to increase student- 
teacher interaction and to promote 
liking for school and sense of 
belonging among students. Reality 
Therapy classroom meetings at both 
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schools aimed primarily to increase 
attachment to school and sense of 
belonging, but if properly imple- 
mented they should also increase 
teacher respect for students, and 
should enhance students' self-con- 
cepts and interpersonal competen- 
cies. Pimlico's scores reflected a 
positive change on many of the meas- 
ures targeted by the Reality Therapy 
classroom meetings. Its students 
liked school much better than in the 
previous year and felt more of a 
sense of belonging. These differ- 
ences are statistically significant. 
Self-concept and teacher respect for 
students also increased, but not 
significantly. Interpersonal Compe- 
tency did not increase. The reports 
of Calver ton's students are less 
clear-cut. They reported liking 
their school better than others in 
the city, but grew significantly 
less attached to people in their 
school. An examination of the grade 
breakdown for these results shows 
that the negative trend is due pri- 
marily to one of the nonexperimental 
units in the school. Students in 
the experimental unit reported feel- 
ing a little less alienated and 
their reports of Attachment to 
School remained even with reports of 
the previous year's seventh grade. 
Student reports of teacher respect 
also showed no change in the experi- 
mental unit, and their self-concepts 
suffered somewhat. Student Inter- 
personal Competency and teachers' 
reports of Interaction with Students 
increased. 

One explanation consistent with 
this pattern of findings is that 
Reality Therapy classroom meetings 
increased Attachment to School, 
Self-Concept, and Respect for Stu- 
dents, and that Pimlico but not Cal- 
verton implemented this strategy 
well enough to bring about these 
changes in the students. At Calver- 
ton, the decreases in alienation and 
increases in Student-Teacher 



Interaction are more likely due to 
the extracurricular activities com- 
ponent than the Reality Therapy com- 
ponent. Calverton'a differences on 
these measures were not large enough 
or consistent enough to conclude 
that any component was very success- 
ful at bringing about the desired 
changes. Pimlico's changes are lar- 
ger and more consistent, and likely 
due at least in part to the Reality 
Therapy. Reality Therapy was the 
only large-scale staff development 
exercise undertaken at Pimlico dur- 
ing the year. Although we have no 
data on actual implementation of the 
techniques, we do know that all the 
teachers received the training. At 
Calverton, all teachers in the 
experimental unit also received the 
training, but these teachers had 
difficulty integrating all the new 
activities at once. The planning 
committee chose to deemphasize Real- 
ity Therapy in favor of some of the 
other activities for the 1983-84 
year. 

Relevance of School . Another 
area Calverton focused on was 
increasing students' perceived rele- 
vance of school. The Career compo- 
nent, which was implemented nearly 
up to the standards specified by the 
planning committee, aimed to 
increase students' perceptions of 
the relevance of school. We have 
several measures of relevance of 
school. We asked students to tell 
us if they had any career goals at 
all, whether they were learning 
things in school that would help 
them achieve their career goal, hov 
many of their subjects they thought 
they had to master in order to reach 
their career goal, and whether they 
felt that they were learning things 
in school that would help them get a 
good job in the future. We also 
asked a number of questions pertain- 
ing to the importance of education 
in general. These general items 
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form a scale called relevance of 
school . Students in the experimen- 
tal unit at Calverton improved on 
all of these measures except the 
relevance of school scale. Only two 
of the ten comparisons for the other 
grades (2 grade levels x 5 measures) 
showed improvement. The magnitude 
of the improvement for the experi- 
mental unit is large. For example, 
only 63% of the previous yearns sev- 
enth grade answered "yes" to Axe 
you learning things that will^help 
vou achieve your career goals ? 
Seventy-one percent of the experi- 
mental seventh grade answered affir- 
matively, and this percentage was 
higher than any of the other grade 
levels as well as for Pimlico stu- 
dents in general. Pimlico improved 
on most of these career-related 
measures also, but the improvement 
was not as great as in Calverton's 
seventh grade. (No component of 
Pimlico' s BBP program was directed 
at this objective.) 

TPflrhpr Ou tcomes 

Community Involve ment . Ca 1 v er- 
ton and Pimlico both planned to 
increase community involvement in 
the school. At Calverton the parent 
volunteer intervention was imple- 
mented well enough to be expected to 
make a measurable difference. The 
Pimlico Community Advisory Committee 
was implemented with some success, 
but was not highly visible to teach- 
ers and students in the school. 
Hence we would expect to see some 
increase in Calverton teachers' 
reports of Parent and Community 
Involvement, and less of an increase 
in Pimlico teachers' reports. This 
is exactly vhat we found. Calverton 
teacher reports rose from the 56th 
to the 7 8th percentile, and Pimli- 
co's from the 33rd to the 35th. The 
experimental teachers at Calverton 
reported even higher Parent and Com- 
munity Involvement— up to the 83rd 
percentile. This makes sense 



because the parent volunteer efforts 
were concentrated in the experimen- 
tal unit. 

ftrhool Climate . At least as 
important as the goals and objec- 
tives of each program component are 
indicators of the school climate in 
general. ESB climate profiles for 
Spring 1982 showed that both schools 
were characterized by low morale, 
lack of teamwork among faculty and 
administrators, and a general low 
level of planning and innovative 
action (see Appendix A). Over the 
duration of the project, both plan- 
ning teams worked hard to create 
structures and arrangements in their 
schools that would facilitate 
change. These organizational devel- 
opment activities— a primary focus 
for both schools— paid off. Survey 
results show that both schools 
improved significantly in Morale.^ 
Both schools improved on teachers 
reports that* tlieir schools are 
places whare innovative planning and 
action occur, and at Pimlico this 
improvement was highly significant 
(from the 7th # to the 43rd percen- 
tile)* In both schools teachers' 
reports indicated increases in the 
effectiveness of administration on 
the Smooth Administration scale. At 
Calverton this dimension showed sig- 
nificant improvement: from the 3rd 
to the 12th percentile. Teacher Job 
Satisfaction and Professional Devel- 
opment also increased in both 
schools* Teachers in the experimen- 
tal unit at Calverton scored well 
above the teachers in the rest of 
the school on the Planning and 
Action and the Smooth Administration 
scales. This set of findings is 
promising because we know that 
morale, a spirit of innovation, and 
teamwork enhance organizational 
development efforts (Berman & 
McLaughlin, 1976). We expect that 
the advances made in these areas 
will pay off in other areas. 
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Discussion 

An open examination of the fac- 
tors that advanced and impeded pro- 
ductivity during the first two pro- 
gram years will help us to learn 
1 about the conditions necessary for 

successful organizational develop- 
ment efforts in schools. The obsta- 
cles and resources described below 
are typical of those that are likely 
to be encountered in some middle and 
secondary schools in any large city. 

Resources 

People t An important conclu- 
sion to be drawn from the ESP is 
that the schools are rich in terms 
of human resources. The people who 
have worked on the Effective Schools 
Project deserve high praise for 
their commitment to improving their 
schools. The planning committee 
members and teachers implementing 
the programs never hesitated to con- 
tribute their time and talent to 
this effort. The planning committee 
members persisted through long, 
often taxing planning meetings and 
they bore the burdon of introducing 
the project to school staff and 
defending it. The difficulty of 
maintaining an open dialogue in the 
face of multiple obstacles cannot be 
underestimated. But the people 
working on the Effective Schools 
Project have persisted through sev- 
eral such difficult situations. 

Teachers are the backbone of 
the Effective Schools Project. If 
they choose not to act, the program 
cannot move forward. The teachers 
have often proven open to change and 
have provided important insights 
into the project. They have never 
refused to implement any component 
of the program. Instead, they have 
worked with the planning committee 
to iron out bugs that impeded pro- 
gress. All have cared enough to try 
the new techniques and to share with 
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the planning committee their opin- 
ions about the techniques. 

The administrators in both 
schools deserve credit for working 
to move the program fotward. Their 
jobs are difficult — often like walk- 
ing a narrow line with teacher 
demands on one side and central 
administration demands on the other. 
Principals must be sensitive to the 
welfare of their staff at the same 
time they faithfully implement dis- 
trict policies that are often unpo- 
pular with staff. All this must be 
done while trying to juggle the 
assorted problems of 1500 students 
and their parents. It is no wonder 
that these administrators sometimes 
find it hard to sit down and rumi- 
nate about the roots of their 
schools' problems or develop perfor- 
mance standards with their staff. 
The administrators \n this project 
have remained open to the organiza- 
tional development activities 
imposed by the Effective Schools 
Project despite the sometimes pain- 
ful nature of the information used 
to guide project activities. There 
have been times that they have been 
cautious about releasing the infor- 
mation to certain groups that might 
misinterpret the information, but 
they have never refused to allow 
information to be gathered and dis- 
cussed. 

The planning committee members 
proved to be a major resource. A 
teacher from Calverton coordinated 
the CARE project at the school while 
teaching a full load of classes dur- 
ing the 1983-84 school year, and is 
currently contributing a substantial 
portion of her study leave time to 
carrying out the project at Calver- 
ton. A counselor from Northwest 
Youth Services has been an active 
participant in the Pimlico planning 
committee — even when attending the 
meetings meant giving up his own 
free time. He and other staff from 
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NYS have provided training in Real- 
ity Therapy to teachers at both 
schools* A district administrator 
has continued as an active member of 
both planning teams after retirement 
made his participation completely 
voluntary. A counselor at Calverton 
put forth Herculean effort to imple- 
ment the Career Exploration activi- 
ties almost singlehandedly during 
the 1983-84 school year. All plan- 
ning committee members, pa6t and 
present, have served the project 
well with their persistence, hard 
work and insight. 

Evaluation resources ♦ Central 
staff and school staff have collabo- 
rated in the evaluation of the proj- 
ect. They have helped us use cen- 
trally located 6tudent records for 
evaluation purposes as well as to 
assist the schools in implementing 
part 6 of their program. For exam- 
ple, central attendance records were 
used to generate a list of chronic 
nonattender6 to be targeted for ser- 
vices at Pimlico. Prior collabora- 
tions with school projects in big 
cities have raised our awareness 
about the complexities of maintain- 
ing a data base for a large, highly 
mobile population. It is a credit 
to the Baltimore City Public Schools 
that their data base is sufficiently 
accurate and current to make it use- 
ful for current project assistance 
as well as the more traditional 
reporting function. 

Support . Staff at all levels 
of the BCPS system have voiced sup- 
port for the Effective Schools Proj- 
ect. The support of district level 
supervisors, subject area coordina- 
tors and the superintendent are an 
essential factor in any school 
improvement effort. The entire 
project would be thwarted at the 
outset without their support. Sup- 
port ha6 been shown in a variety of 
ways: The Deputy Superintendent of 
Planning, Research and Evaluation 



addressed the planning committees at 
the initial workshop; the Superin- 
tendent met with members of the 
planning committee after the first 
year to learn about the project and 
to offer her support. Subject Area 
Coordinators, Regional Superinten- 
dents and Executive Directors under 
the Superintendent have kept them- 
selves informed about the project 
and have attempted to coordinate 
their other activities with project 
activities. Staff development per- 
sonnel have assisted with teacher 
training activities. The system has 
contributed funds for substitute 
teachers to cover classes of teach- 
ers who were being trained, and 
recently offered matching funds for 
a grant being sought from a local 
fund for educational excellence. 

Obstacles 

A requirement for the success 
of any school improvement ef- 
fort — indeed any organizational 
development effort — i6 that informa- 
tion is to be valued. Information 
about problems and obstacles are to 
be cherished as much as information 
about progress and resources. Pro- 
gress can be made only when diffi- 
culties are openly recognized and 
confronted* Common sense and accu- 
mulated experience converge in 
implying that educational leaders 
who identify and confront problems 
are more effective than those who^ 
ignore these problems • It is a sign 
of the wisdom and maturity of the 
faculty, principals, and district 
administrators participating in the 
Effective Schools Project that they 
share with us thi6 view of the value 
of information. Despite the pres- 
sures that often exist in large 
bureaucracies to behave as if prob- 
lems do not exist, the Effective 
Schools Project ha6 operated primar- 
ily in an atmosphere of frank and 
open discussion* 
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Staff stability . Instabil ity 
in staffing can be a huge problem 
for school- improvement efforts* and 
the assumptions underlying the PDE 
method help us to understand why. 
The method assumes that an innova- 
tion will be implemented most faith- 
fully when the implement en under- 
stand and accept the theory 
underlying the effort. The theory- 
generating segment of the PDE model 
is time consuming, involving careful 
and systematic consideration of the 
major factors contributing to the 
organization's problems. The pro- 
cess involves long hours of discus- 
sion, during which evidence about 
causes is discussed, accepted or 
rejected by the group, and carefully 
translated into clear objectives. 
Interventions are carefully tailored 
to those objectives. Persons who 
persist through the entire process 
have a clear understanding of the 
rationale for their program and the 
choice of interventions. Persons 
merely informed about the results of 
the process have less of an under- 
standing of why the specific inter- 
ventions were selected, and persons 
merely told to implement the inter- 
vention have no understanding. 

Both planning committees 
started out with ten members. They 
both lost three by the start of the 
second year. These three were 
reolaced with four new members in 
one school and seven new members in 
the other* By the beginning of the 
third year, staff turnover again 
resulted in the loss of two and four 
planning committee members from the 
two respective teams. 

Turnove: also affected the pro- 
gram at the teacher- implementer 
level. Of the 27 teachers in Cal- 
verton's seventh grade unit during 
1983-84, eight, or 30Z, were trans- 
ferred in too late to include them 
in the Fall teacher training. This 
last minute transferring of teachers 



caused a major setback for the pro- 
gram: A large proportion of the 
teachers in the unit did not receive 
the initial orientation to the pro-, 
gram and the rationale behind the 
choice of interventions; they did 
not receive the initial training 
necessary to implement the classroom 
innovations. The implementation of 
the classroom interventions was 
slowed considerably while we tried 
repeatedly to find time for the rest 
of the teachers to be trained. One 
of the three segments of the train- 
ing was not offered again until the 
following Fall. 

During the summer months of 
1983 the principal and two assistant 
principals at Pimlico Junior High 
retired or were transferred, and a 
new assistant principal was placed 
in the seventh grade unit at Calver- 
ton. The head of the guidance 
department at Calverton, who chaired 
the planning committee, also trans- 
ferred to another school. All of 
these changes were made over the 
summer months between the planning 
year and the first year of implemen- 
tation, making it impossible to pre- 
pare the new planning groups for the 
project before the beginning of the 
school year. In some cases we were 
unaware of staff changes until after 
the beginning of the school year* 
This high degree of staff turnover 
appears typical in this school sys- 
tem and school personnel are accus- 
tomed to starting each year with a 
sense of uncertainty. 

Selection of schools . Fullan", 
Miles and Taylor (1980) suggest that 
the overriding selection criteria 
for projects like the ESP must be 
"OD readiness" as opposed to per- 
ceived urgency or need for services. 
According to Fullan et al., "readi- 
ness" is greatest when the following 
conditions are present: 
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1. A spirit of collaboration 
exists, and open communication 
is possible and valued* 

2. The administration is supportive 
of (or at least not negative 
toward) the OD intervention. 
This includes district support 
from central administrators as 
well as the principal's commit- 
ment, support, and involvement. 
Financial investment is a good 
indicator of pocential success 
of the program. 

3. The organization does not have a 
history of one failed innovation 
after another. 

4. All members of the staff are 
involved in the decision to par- 
ticipate in the project. Pullen 
et al. suggest three or four 
meetings over a two-month period 
to introduce OD and describe how 
it works to the staff. They 
also suggest that the commit- 
ments (in terms of staff time 
and resources) that each of the 
organizations will make to the 
OD effort and the time line for 
the project should be specified 
and agreed upon before the proj- 
ect is started. 

The Fullan et al. criteria for 
OD readiness appear sensible, but 
were these criteria always applied 
in school improvement initiatives, 
the schools most in need of improve- 
ment would never be selected. One 
aim of the ESP is to learn how to 
bring about the conditions Fullan et 
al. describe. The two schools par- 
ticipating in the ESP would have 
been rated low on the OD readiness 
criteria when the project began, and 
they would be rated considerably 
higher now* 

Climate assessments show that 
when the project began, both schools 



were demoralized. Little spirit of 
collaboration existed between the 
faculty and administration at Cal- 
verton — the climate was character- 
ized by mistrust and fear of admin- 
istrators among teachers. In the 
Spring of 1982, during the planning 
year for the project, Calverton and 
Pimlico scored at the 7th and 6th 
percentiles on staff Morale on the 
norms for the ESB. They scored at 
the 3rd and 23rd percentiles on 
teacher perceptions of staff-admin- 
istration cooperation. Teachers 
were initially unwilling to let 
observers into their classrooms for 
fear that information derived from 
the observations would be used 
against them by the principal. Some 
teachers even expressed reluctance 
to use the disciplinary referral 
system because they feared what 
might happen if the school adminis- 
tration thought that they were hav- 
ing a problem controlling their 
classrooms. During the faculty 
meeting at which the program was 
first introduced to teachers, at 
least one faculty ©ember wondered 
vby the system would try such a pro- 
gram at Calverton. He felt that 
Calverton' s situation was hopeless. 

The second "OD readiness 11 cri- 
terion has to do with support. The 
schools would have scored high on 
this factor in terms of support from 
the central administration. Pimlico 
was initially weak on principal sup- 
port and involvement but improved 
drastically in the second year. 

The thir'i criterion is the 
absence of a history of failed pro- 
grams. Many different programs have 
been tried :n the school system. 
Some teachejs try to wait-out new 
programs, homing that the program 
will disappear before the teacher 
has to act. New initiatives are 
often met with skepticism by school 
people, and there are often insuffi- 
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cient resources to work intensively 
with the school personnel to over- 
come the skepticism and to provide 
sufficient support to implement the 
program well. Our schools would 
probably have received low scores on 
the third "OD readiness M criterion. 

Finally , school staff were not 
a part of the decision to join the 
Effective Schools Project. One of 
the first year's activities was to 
engage teachers in a dialogue about 
the project and to gain their sup- 
port. No dialogue occurred at Pim- 
lico in the first year, but a series 
of activities at Calverton was suc- 
cessful at gaining support from many 
teachers. 

The positive results achieved 
in the first two years of the proj- 
ect show that school improvement 
efforts can lead to progress even in 
difficult school s, although the 
experience also illustrates the val- 
idity of Fullan et al.'s "readiness" 
criteria. Progress has certainly 
been slowed while the project has 
attempted to create conditions like 
those recommended by Fullan et al. 

Clear Understandings . Fullan 
et al. also recommend written agree- 
ments about the scope of the proj- 
ect. Our experience leads to the 
same conclusion. Although we wrote 
our expectations in a proposal docu- 
ment (Delinquency Program, 1982) and 
a letter (dated 5/18/82), the state- 
ments were not clear enough. After 
initial meetings with the school 
system we thought ve had agreed to 
an experimental design involving 
comparison schools and that the sys- 
tem would provide certain 
resources — including staff develop- 
ment personnel time and materials 
for teacher training. When ve were 
ready to administer the baseline 
survey to the treatment %id control 
schools we were informed that no 
survey could be given in the control 



schools, and when we contacted the 
staff development office for train- 
ing assistance, we learned that they 
had not been informed by the former 
Deputy Superintendent for Research 
and Development that their assist-* 
ance had been promised, and they 
could provide only a fraction of the 
assistance that we requested. Such 
misunderstandings eat up valuable 
staff time and slow progress while 
resolutions are sought. 

Professional discretion versus 
programmat ic implementation. This 
problem appears common in school 
interventions. Much of the specula- 
tion about the importance of local 
initiative in program implementation 
(Berman & McLaughlin, 1976) appears 
related to the perceived need for 
flexibility during implementation to 
allow each locality to modify a pro- 
gram to suit its own needs. Flexi- 
bility is good in principle, but if 
the program being implemented is a 
specific, well-engineered set ot 
procedures developed over a long 
period of time in diverse settings, 
modifications may be at odds with 
the theory or technology undergird- 
ing the intervention and may under- 
mine its efficacy. 

We found it difficult to cope 
with this problem in the Effective 
Schools Project. The desire for 
professional discretion is sometimes 
manifested in the planning stage as 
a reluctance to specifying concrete 
performance standards for school 
staff. This reluctance is more com- 
mon for nonteaching positions than 
for teaching positions. Staff mem- 
bers do not find it as objectionable 
to specify the instructional methods 
and curriculum to be used by a 
teacher as to specify a counseling 
strategy or standards for disciplin- 
ing students referred to the office. 
The methods and materials used to 
perform the guidance and administra- 
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tive functions are determined at the 
school-level with assistance from 
the central office. This arrange- 
ment affords more discretion to 
school personnel. Assistant princi- 
pals are free to exercise their own 
administrative style in disciplining 
students. The same holde for 
counselors in counseling students 
and principals in supervising the 
school staff. School staff, parti- 
cularly guidance and administrative 
staff, were frequently resistant to 
specifying implementation standards 
for their own performance. This 
resistance sometimes made it diffi- 
cult to implement the PDE method. 

Desire for professional discre- 
tion appears more at the implementa- 
tion stage than at the planning 
stage with teachers. Their methods 
and materials are more standardized 
than are guidance counselors' and 
administrates' . Teachers seem 
willing to accept the idea of stan- 
dards for their own performance, but 
they often modify the standards for 
their own convenience or so that 
they better suit their own teaching 
styles. 

T>fpprrjir inn of proie ct into 
school o perations . The PDE process 
is a management tool based on a spe- 
cific philosophy of management. 
Differences between the PDE philoso- 
phy and the management philosophy 
that governs an organization can 
reduce the efficacy of the PDE pro- 
cess. The PDE process may operate 
in tandem with a management system 
which is philosophically at odds 
with it for some time. Clashes in 
styles become apparent only occa- 
sionally, and are often brushed off 
or ignored. In both of the Effec- 
tive Schools Project schools the 
administration of the school is 
guided by a different philosophy 
than is the PDE process. The prin- 
cipals have a top-down orientation; 



the PDE method calls for staff 
participation. The principals are 
intuitive; PDE is information- dri- 
ven. 

A loose management style often 
characterizes schools (Weick, 1984). 
This style sometimes affects the 
everyday operation of educational 
programs by undermining schedules. 
"Things come up" that prevent syste- 
matic activities from being imple- 
mented according to schedule. Of 
course this is true in any organiza- 
tion, but in some schools it seems 
to be the rule. Programmatic activ- 
ities are seldom carried out as 
planned because some more immediate 
problem supersedes the planned 
activity. A "we'll see" attitude 
pervades the schools. 

Criiis management does not mesh 
well with the PDE method. The PDE 
method relies on long-term program- 
matic reform, on persistence, on 
far-sightedness. Short-term crisis 
management is often needed, but it 
steals the resources necessary for 
long-term reform. 

Building-leye! leadership . The 
ratio of full-time school-based to 
other Pimlico planning committee 
members was low, and leadership was 
lacking among the school-based mem- 
bers. The principal was congenial 
and caring, but he failed to provide 
the support necessary for team mem- 
bers to implement their plans when 
they got back into the school* He 
was reluctant to orient the entire 
faculty to the project because he 
wanted to iron out all of the bugs 
in the plan before presenting it. 
No other team members from the 
school assumed a leadership role. 
The most active members of the com- 
mittee were personnel from the cen- 
tral staff and from community organ- 
izations. 
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Part of the difficulty in 
selecting interventions to address 
Pimlico's objectives may have 
resulted from changes in the Hopkins 
staff person working with the group. 
The original researcher assigned to 
this project left Hopkins ir the 
middle of the first year and was 
replaced by a researcher who was 
less skilled at keeping the group on 
task. Lack of leadership in the 
group coupled with a less assertive 
facilitator slowed the group's pro- 
gress* 

By the end of the school year, 
the group was still struggling with 
a long list of program objec- 
tives — trying to narrow the list to 
focus a program on the most pressing 
problems, but unable to conclude 
which were the most important. 
Evaluative information fro© surveys, 
interviews or observations would 
have helped at this point, but were 
not available* We tried to rely on 
the impressions of the planning 
group members, but priorities dif- 
fered. 

Pressed for time, the group 
decided to try the classroom innova- 
tions that the Calverton group had 
decided upon. They were among the 
many interventions being considered 
by the group, and the training ses- 
sion seemed a good opportunity. 
Planning committee members hastily 
oriented the faculty and recruited 
volunteers to attend the Fall train- 
ing. Of the twenty-three teachers 
who volunteered, ten attended the 
August training. We discovered 
later that the volunteers were not 
clear about what they had volun- 
teered for. They had signed up pri- 
marily to obtain the inservice 
credit being offered. 

In retrospect we should have 
altered the planning team composi- 
tion early in the year to include 



leaders froa the school, and we 
should have provided more assistance 
to the researcher who was struggling 
to bring some closure to the pro- 
cess. It would also have been help- 
ful to include the principal's 
supervisor, the Regional Superinten- 
dent, on the committee. 

Conclusions and Recommendations 

Although the ESP is still in 
progress, some conclusions and 
recomnendations can be made now. 
The schools participating in this 
project are improving. Staff 
Morale, staff perceptions of their 
schools as organizations which plan 
and act to improve, and cooperation 
between the staff and the adminis- 
tration are higher after one year of 
program implementation than they 
were the prior year. These differ- 
ences are large and statistically 
significant. These are promising 
chances because they create the 
necessary conditions for real, last- 
ing innovations. 

Also promising are preliminary 
findings of improvements in outcomes 
of the specific program components. 
Students in Calver sea's experimental 
unit report that school is more 
relevant to their lives than did 
seventh graders in the previous 
year's cohorts. They also report 
receiving more rewards for their 
school work. Students at Pimlico 
are less alienated than they were a 
year ago and like school more. Stu- 
dents and teachers in both schools 
think that their schools are safer 
places than they were the previous 
year. 

Despite difficulties in apply- 
ing the Program Development Evalua- 
tion method in these two schools, 
the method appears to be robust. 
Recommendations at this point in the 
project suggest ways to facilitate 
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the application of PDE in future 
projects: 

1 . Provide training in the PDE 
method to school staff and their 
supervisors before the project 
begins. Ve kicked off the project 
with a training and orientation 
workshop for the planning committee 
members and the central office per- 
sonnel assigned to the project* 
This was not enough* School staff 
have many supervisors, and all of 
them need to understand what the PDE 
method entails. Ideally the higher- 
level managers would use the PDE 
method or a similar planning tool to 
generate their own management plans 
and to supervise their staff. But 
the higher- level managers must at 
least have an appreciation for the 
kind of systematic planning that 
undergirds the program activities so 
that they will be less likely to 
make decisions or take actions that 
disrupt these plans. School staff 
should have more early understanding 
about what they are getting into. 
Consensus on the principles underly- 
ing the PDE method must be gained 
before the start of the project. 
Agreement with the basic ideas of 
planning, evaluation, schedules and 
quality-control standards for per- 
formance cannot be assumed. Ideally 
the project would be discussed with 



the entire staff and volunteers 
would be recruited to serve on the 
planning committee. This committee 
would then receive training in the 
PDE method before beginning to plan. 

2. Staff stability must be 
ensured. There must be a commitment 
at all levels to maintain the key 
personnel in the school during the 
initial years of the project. Even- 
tually the culture of the organiza- 
tion will change enough so that 
staff instability has a minimal 
effect on project effectiveness, but 
in the early years it is crucial 
that key people remain in the 
school. 

3. School improvement is possi- 
ble. The Effective Schools Project 
demonstrates that difficult schools 
will improve under an intensive 
organizational development interven- 
tion. However, additional experi- 
mentation is required to learn the 
most efficient way to structure the 
organizational development interven- 
tion. We need, for example, to 
study the effects of giving central 
administrators a more meaningful 
role in the process, and of involv- 
ing school-level staff intensively 
for only a subset of the planning 
steps. 
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SCIIOUL CUMPUSIIIONAL CLIMATE: STUDEHf CHARACTER I S II CS AND BEHAVIOR 
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SCHOOL COMPOSITIONAL CLIMATE 
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This appendix describes the item content of student scales derived 
from sources other than the Effective School Battery (Gottfredson, in 
press) ♦ The scales are found on the following pages : 



Self-Reported Delinquency (Total) 


Bl 


Self-Reported Serious Delinquency 


B3 


Self-Reported Drug Uee 


B4 


Rebellious Autonomy 


B5 


Attachment to Parents 


B6 


Parental Kaphas is on Education 


B7 


Rebellious Behavior in School 


B8 


Nonacademic Rewards 


B9 


Relevance of School 
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Self-Repor ted Delinquency (Total) 

In the last year have you * . . 

...purposely damaged or destroyed property belonging to a school? 

0 No 

1 Yes 

...purposely damaged or destroyed other property that did not belong to you, 
not counting family or school property? 

0 No 

1 Yes 

...stolen or tried to steal something worth more than $50? 

0 No 

1 Yes 

.. .carried a hidden weapon other than a plain pocket knife? 

0 No 

1 Yes 

...been involved in gang fights? 

0 No 

1 Yes 

...sold marijuana or other drugs? 

0 No 

1 Yes 

...hit or threatened to hit a teacher or other adult at school? 

0 No 

1 Yes 

...hit or threatened to hit other students ? 

0 Ho 

1 Yes 

...taken a car for a ride (or drive) without the owner's permission? 

0 No 

1 Yes 

...used force or strong-arm methods to get money or things from a person? 

0 No 

1 Yes 

...stolon or tried to steal things worth less than $50? 

0 No 

1 Yes 

...stolen or tried to steal something from a school, such as someone's coat 
from a classroom, locker, or cafeteria, or a book from the library? 

0 No 

1 Yes 

...broken or tried to break into a building or car to steal something or 
just to look around? 

0 No 

1 Yes 
...smoked cigarettes? 

0 No 

1 Yes 

...drunk beer, wine, or "hard" liquor? 

0 No 

1 Yes 

. . .smoked marijuana (grass, pot, ganja)? 

0 No 

1 Yes 

Bl 
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In the laat year have you. . . 

...taken some other drugs? 

0 No 

1 Tea 

...tone to school vhen you were drunk or high on some drugs? 

0 No 

1 Tea 

...aniffed glue, paint, or other spray? 

0 No 

1 Tea 



Scale acore is mean item 

Male 
Mean ■ .16 
Mdn. » .11 

SD - .18 

Alpha - .86 



e. Range is 0 to 1 . 

Female 
Mean - .10 
Mdn. - .05 
SD- .13 



Note . Scale statiatica reported here are taken from the School Action Effec- 
tiveness Study (Gottfredson, 1982) . 
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Self-Rcportgd Serious Delinquency 



In tht last year have you**, 

... purposely damaged or destroyed property 
belonging to a school? 

...purposely damaged or destroyed fiifetl 
property that did not belong to you, not 
counting family or school property? 

...stolen or tried to" steal something worth 
more than $50? 

...carried a hidden weapon other than a 
plain pocket knife? 

...been involved in gang fights? 

...hit or threatened to hit a teacher or 
other adult at school? 

...taken a car for a ride (or drive) without 
the owner's permission? 

...used force or strong-arm methods to get 
money or things from a person? 

...stolen or tried to steal something worth 
less than $50? 

...stolen or tried to steal something at 
school, such as someone's coat from a class- 
room, locker, or cafeteria, or a book from 
the library? 

...broken or tried to break into a building 
or car to steal something or just to look 
around. 



Yes 



Scale score is mean item score. Range is 0 to 1. 
Kale 



Mean 

Mdn. 
SD 



.12 
.00 
.19 



Female 
Mean - .04 
Mdn. - .00 
SD- .10 



Alpha - .82 



Note . Scale statistics reported here are taken from the 
School Action Effectiveness Study (Gottfredson, 1982). 
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Self-Reported Drug Use 



In tht last year have you*** Yea Ho 

... smoked cigarettes? 1 0 

•••drunk beer, wine, or "hard" liquor? 1 0 

•• •smoked marijuana (grass, pot, ganja)? 1 0 

•••taken some other drugs? 1 0 

•••gone to school when you were drunk 

or high on some drugs? 1 0 

•••sniffed glue, paint, or other spray? 1 0 



Scale score is mean item score* Range is 0 to 1 • 



Male 

Mean - .22 

Mdn. - .18 

SD « .27 

Alpha « .78 



Female 
Mean * .21 
Mdn* - .02 
SD - .27 



ERLC 



Note . Scale statistics reported here are taken from the 
School Action Effectiveness Study (Gottfredson, 1982). 
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ggfegJJifliti totems 

Trut False 

I don't like anybody tilling »e what do do. 1 0 

Whether or not I spend tine on homework 

is «y ovn business. 1 0 

I should not have to explain to anyone 

how I spend my money 1 0 



Scale score is mean item score. Range is 0 to 1 . 



Male Female 

Mean - .62 Mean • *63 

Mdn. ■ .64 Mdn. ■ .68 

SD « .33 SD « 35 

Alpha « .47 



Mote . Scale statistics reported here are taken from the 
School Action Effectiveness Study (Gottf redson, 1982). 
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Attachment to Parents 



How much do you want to be like the kind of person your mother (or guar- 
dian) is? 

1 Very much like her 

1 Somewhat like her 

0 A little like her 

0 Not very much like her 

0 Mot at all like her 

How close do you feel to your parents (or guardians)? 

1 Extremely close 
1 Quite close 

0 Fairly close 

0 Mot very close 

How much do you want to be like the kind of person your father (or guar- 
dian) is? 

1 Very much like him 
1 Somewhat like him 

0 A little like him . 
0 Not very much like him 

0 Not at all like him 

All in all, how much do you like your parents (or guardians)? 

1 Like them more the a anyone else likes theirs 
0 Like them a lot 

0 Like them some 

0 Neither like nor dislike them 

0 Dislike them 

I vould not care if my parents were a little disappointed in me. 

0 True 

1 False 

I have lots of respect for my parents* 
1 True 
0 False 

Scale score is mean item score. Range is 0 to L Alpha * .57 



Note . Scale statistics reported here are taken from the School Action 
Effectiveness Study (Gottfredson, 1982). 



Mean " .61 

Mdn. " .66 
SD - .30 



Male 



Female 
Meat " 
Mdn. - 



.59 
.66 
.27 



SD " 
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WEST COPY AVAILABLE 



P*r«it*l Knohatia on Education 

Do your partntt want you to go. to collagt tomeday? 

1 Its, very much 
0 Yet 
0 So 

0 Ho, not at all 

0 Hot tort 

My parente keep dote track of how veil I an doing in tchool. 

1 True 

0 Falte 

My mother (or guardian) helpt me with my homework. 

1 True 
0 Falte 

Score it mean item retponte. Range ic 0 to 1 • 



Male 

Mean - .52 

Mdn. - .51 

SD - .30 

Alpha - .51 



Female 

Mean ■ .57 
Mdn* »58 
SD - .30 



Nole. Scale statistics reported here are taken from the 
School Action Effectiveness Study (Gottf redson, 1982). 



B7 

65 



Rfhjll fom Behavior in School 
How often do yo Jo the following things? . . . 
Fight or argue with other students 
Argue with your teachers 
Goof-off in class so others can't work 
Cone late to school 

Do things that you know will make the teacher 
angry 

Cheat on tests 

Copy someone else's assignments 
Come late to class 

Responses to all items are as follows: 

5 ■ Almost always 

4 ■ Often 

3 ■ Sometimes 

2 - Seldom 

1 * Never 

Scale score is mean item score • Range is 1 to 5. 

Mean ■ 1.87 
SD « .63 
Alpha - .74 



Note * This scale is taken from the Youth in Transi- 
tion Study (Bachman, 1975). 
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Noaacademjc guards 



Ho* of t*n do the following things happen to you in 
your school? 

Teachers say nice things about things I do other 

than ay iclwolwrt* 

I get a chance to do the things that I can do 



In the last month have any of these things happened 
to you in school? 

Did you vin an award or prize for something that 
you did other than schoolvork? 

Responses to the first two items are: 



veil. 



1 « Often 

2 - Sometimes 

3 " Hardly ever 



Responses 



to the third item are 



1 - Yes 

2 m Ho 



Scale score is mean item score. 



Mean * 1 .90 
SD - .42 
Alpha - .40 
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BftHamafi Qf School 
How much do you agree with the following statement*? 

In school I learn more about things I want to 
know. 

School gives ae a chanci to learn many interest- 
ing things. 

When I'm in school I feel I'm doing something 
that is really worthwhile. 

In school I an improving my ability to think and 
solve problems. 

In school I am learning the things I will need to 
know to be a good citizen. 

All people should have at least a high school 
education. 

An education will help me to be a mature adult. 

A high school diploma is the only way to get 
ahead. 

Responses to all items are as follows: 

4 - Very much 
3 ■ Pretty much 
2 - A little 
1 - Mot at all 

Scale score is mean item score. Range is 1 to A. 

Mean - 3.15 
SD - .58 
Alpha - .75 



Note . Items are adapted from the Youth in Transi 
tion Study (Bachman, 1975). 
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TabU CI 
Teacher Characteristics Scales 



Structured Teaching Style (SIS) 



Classrooms differ in many ways depending upon the philosophy and goals of the teaching staff, 
needs of children, etc* Each statement in Column A it matched with a contrasting statement in 
Column B, For each pair, place an X inside the parentheses which comes closest to describing 
your own classroom* 



Column A 
Children work independently 

Emphasis on emotional needs 

Various activities take 
place at the same time 

Children choose their own 
activities and materials 

Individual needs dominant 

Children interact freely 
with each other 

Children change places 
freely 



Almost 
Always 
Like A 

(1) 



(I) 
(1) 

(1) 

(1) 
(1) 

(i) 



Somewhat 

Like A and 
Somewhat 

Like B 



Alnost 
Always 
Like B 



(2) (3) (4) (5) 



(2) 
(2) 



(3) 
(3) 



(4) 
(4) 



(5) 
(5) 



(2) (3) (4) (5) 



(2) 
(2) 



(3) 
(3) 



(4) 
(4) 



(5) 
(5) 



(2) (3) (4) (5) 

Vocabulary 



Column B 

Children work under adult 
auperviaon 

Emphasis on subject matter 

All the class is -engaged 
in the same activity 

Teaching staff determines 
activities and materials 

Group needs dominant 

Children do not interact 
freely with each other 

Children have assigned 
seats 



Which of the following responses first cornea to your mind when you see the word INTIACTABLE? 

0 Suspicious 

1 Unruly 
0 Wicked 

0 Never heard of the word 

Which of the following responses first cornea to your mind when you see the word PLACATE? 

0 Chemical 

0 Sign 

1 Appease 

0 Scold 

9 Hever heard of the word 
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Table CI (contJ 



Page 2 of 2 



Vocabulary (Cont.) 

co«. to your mind when you tee the word LIMPID? 



1 Transparent 

0 Sea animal 

0 Lame 

0 Never heard of the word* 



Which of the following re.pon.ee fkil comes to your mind when you see the word PHLEGMATIC? 



0 Hippy 

0 Sparaodic 

1 Sluggish 

0 Never heard of the word 



Which of the following re.pon.ee firfj. come, to your mind when you see the word ODIOUS? 



0 Bad humored 

0 III- reel ling 

1 Detestable 

0 Never heard of the word 



Which of the following responses lint come, to your mind when you see the word ORISON? 



0 Song 

0 Constellation 

1 Prayer 

0 Never heard of the word 



Which of the following responses fiat comes to your nind when you see the word SACROSANCT? 



0 Sacrificial 

0 Dormant 

1 Inviolable 
0 Gullible 

0 Never heard of the word 



Which of the following responses first comes to your mind when you see the word HIATUS? 

0 Animal 

1 Gap 

0 Calamity 

0 Never heard of the word 

Which of the following responses £ii&l comes to your mind -hen you see the word HARBINGER? 

1 Forerunner 

0 Well-tailored 
0 Fortune-teller 

0 Never heard of the word 

^rinn"no«"ir^"*verairi^rre.^nte. Alpha Reliability equals .65 for STS and .73 
for Verbal Ability. 



ERIC 



71 

C2 



Appendix D 



This appendix contains comparisons of 1983 to 1984 scores for each 
school on all outcomes. Table Dl shows the scale scores and percentiles 
for all survey measures as veil as the t-value for the comparison of: the 
1984 to the 1983 score. Table D2 shows attendance, achievement, and 
discipline data from central school records. Pages D5 to D50 contain 
graphs showing change from 1983 to 1984 by school for the survey mea- 
sures. Pages D51 to D73 show similar graphs by grade level for Culver- 
ton. On all graphs stars following the school name indicate statistical 
significance of the difference between the 1983 and 1984 scores. One 
star indicates significance at the jl<.05 level and two stars at the 
o<.01 level. 

Graphs Showing 1983-84 Change, by School 
Teacher Reports of School Climate 
Safety 
Morale 

Planning and Action 
Smooth Administration 
Resources 
Race Relations 

Parent/C ommun i t y Invo 1 veme nt 
Student Influence 

Avoidance of the Use of Grades as a Sanction 



Page 

D5 
D6 
D7 
D8 
D9 
DIO 
Dll 
D12 
D13 
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Teacher Characteristics 

Pro-integration Attitudes 1)14 

Job Satisfaction 015 

Interaction with Students 1)16 

Personal Security 1)17 

Classroom Orderliness Dl8 

Professional Development &19 
Nonauthoritarian Attitudes 

Student Reports of School Climate 

Safety 1)21 

Clarity of Rules 1)22 



Fairness of rules 
Student Influence 



Respect for Students 
Student Characteristics 
Negative Peer Influence 
Interpersonal Competency 



Attachment to School 



Parental Education 
Educational Expectations 
School Rewards 



D23 
D24 



Student-Teacher Interaction 



D26 

D27 
D28 



• D2Q 

Alienation u * 7 



D30 



Belief in Rules 1)31 

D32 



D33 
D34 



School Punishment D3 ** 
School Effort D36 
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Non-ESB Student, Characteristics 



Self-Reported Delinquency 


D37 


Self-Reported Serious Delinquency (Total) 


D38 


Self-Reported Drug Involvement 


D39 


Rebellious Autonomy 


D40 


Percent with Career Goals 


D41 


Percent Learning Useful Things 


D42 


I like iny school . . . 


D43 


I stick to course of action 


D44 


Number of subjects I must master 


D45 


Rebellious Behavisr in School 


D46 


Nonacademic Rewards 


D47 


Percent Suspended This Term 


D48 


Attachment to Parents 


D49 


Parental Emphasis on Education 


D50 
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Graphs Showing 1983-84 Change, by Grade, Calverton 
Student Reports of School Climate 
Safety 

Clarity of Rules 
Fairness of Rules 
Student Influence 

Student-Teacher Interaction 
Respect for Students 
Student Characteristics 

Interpersonal Competency 

Alienation 

Attachment to School 

Belief in Rules 

Educational Expectations 

School Rewards 

School Effort 
Non-ESB Characteristics 

Self-Reported Serious Delinquency 

Self-Reported Drug Involvement 

Percent with Career Goals 

Percent Learning Useful Things 

I like my school • • • 

I stick to course of action 

Rebellious Eehavior in School 

Nonacademic Rewards 

Percent Suspended This Term 

Parental Emphasis on Education 



D51 
D52 
D53 
D54 
D55 
D56 

D57 

D58 

D59 

D60 

D61 

D62 

D63 

D64 

D65 

D66 

D67 

D68 

D69 

D70 

D71 

D72 

D73 
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Table »1 

Means and Percentiles for All Effective Schools 
Project Survey Meaaures— 1983 and 1984 

Calverton Pimlico 

Me " ur * I'm 1984" t 1983 1984 

Effective Schoola Battery: Teacher Reporta of School Climate 

3~12~"(9) ~3.44 (30) 3.07** 2.71 (1) 3.14 (10) 4.18** 

l mft ? i\l 7 1.47 26 3.03** 1.34 ( 6) 1.43 (18 ) 2.01* 

Mortl ? , , ■ 153(38 159(56) 1.59 1.35 (7) 1.54(43) 4.53** 

Planning and Action .53 (38 1.59 56 l « K ^ 

IS&J'S'SV- of X* («) lli <» -» X.62 (2) X.«» (7) X.60 

Gradea aa a Sanction 

Effective School Battery: Teacher Characteriatica 

Job Satiafaction w Tf „ #..» 2 u (2 4) -.94 

Interaction vith Student. 2. 8 (35 2. (56 . .96 2. 41) 2.11 (24) .9 

Per.onal Security .76 5 .75 U J* Q6) ^ 

Cl.a.roo- Orderlin... JJJ (4 2.3 J J x x 1.47 (33) 1.41 

Profe.aional Development 1.47 32 1.55 61 */ (9) 1>63 

Nonauthoritariau Attitude* 2.28(15; z.Jo^j; 

Effective School Battery: Student Rep^f of School Cliaste 

"""""" 71 (1 o\ 1.34 .65 (8) .69 (19) 1.7 4 

S ! fe ^ t . . fo 8, J9 91 19 76 (78) .80 (92) 1.01 

Clarity of Rule. .79 89 .79 91J j 62 (M) <40 

Fairness of Rule. .62 49 .57 24 J ^ (M) 92 

Student Influence .39 (50 .38 ^o w .64 ( 27) -.07 

ESTl^aST"* - " :5 c <8 :S 88 -a . » <» > .1* <» > •» 
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Table Dl (Continued) 



Page 2 of 3 





Cr lverton 


Pimlico 




Measure 


1983 1984 t_ 1983 


1984 






Effective School Battery: Student Characteristics 



Negative Peer Influence 

Interpersonal Competency 

Alienation* 

Attachment to School 

Belief in Rules 

Parental Education 

1 Expecting Pott-High School 

Education 
School Rewards 
School Punishments e 
School Effort 
Self-Esteem 
Involvement 



.24 (55) 
.74 (25) 
.44 ( 85) 
.67 (49) 
.66 (39) 
2.05 ( 43) 

.81 (77) 
.23 (27) 
.34 (96) 
.62 (58) 
.76 . ~° 



.25 (62) 1.26 
.76 (35) 1.23 
.42 (75) -1.78 
.65 (37) -2.18* 
.70 (68) 3.37** 
2.08 (45) .53 



.23 (48) 
.75 (32) 
.46 (90) 
.66 (44) 
.69 (64) 



.22 
.75 
.41 
.68 
.70 



(43) 
(28) 
(71; 
(53) 
(68) 



2.14 (50) 2.25 (58) 



.72 
.26 
.33 
.60 
.74 
.19 



(53) 

(42) 

(95) 

(49) 
c 

~~d 



-4.30** 
2.50* 
-.94 
-1.13 
-1.63, 



.77 (67) 
.21 (21) 
.31 (92) 
.58 (36) 
.73 , 



.79 (74) 

.29 (58) 

.31 (91) 

.59 (39) 

« 75 -d 

*19 - d 



-.84 
-.38 
-3.20** 
1.58 
.49 
1.85 

1.84 
5.56** 
-.33 
.37 
1.25, 



Additional Student Characteristics 



Self-Reported Delinquency 
S-R Serious Delinquency 
S-R Drug Involvement 
Rebellious Autonomy 
Attachment to Parents 
Parental Emphasis on 

Education 
X With Career Goa 1 s 
2 Would Fight if Asked 
"I stop to consider whether 

or not what I am doing 

is helping me to achieve 

my goals 



.18 (64) 


.16 (54) 


-2.56* 


.14 


(42) 


.14 (47) 


1.03 


.13 


(73) 


.11 (55) 


-3.20** 


.10 


(49) 


.10 


(51.) 


.46 


.21 


(41) 


.20 (38) 


-.90 


.16 


(28) 


.18 


(34) 


2.20* 


.63 


(41) 


.61 (39) 


-.88 


.59 


(36) 


.58 


(35) 


-.76 


.66 


(84) 


.66 ( 83) 


.31 


.66 


(85) 


.67 


(86) 


.31 


.62 


(74) 


.59 (61) 


-2.12* 


.60 


(64) 


.65 


(83) 


3.07** 


.87 




.89 


1.49 


.89 




.91 




.97 


.72 




.7 2 


.31 


.69 




.69 




-.01 


(.17 




3.14 


-.64 


3.13 




3.15 




.25 
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Table Dl (Continued) 
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Measure 



A 
O 

o 

OS 



1983 



Calvert on 
1984 



1983 



Piml ico 



1984 



Additional Student Characteristics (Cont.) 



X "Laming thirds* in school 
that will help you 
achieve your career goal 11 
fl I like my school better 
than other junior high 
schools in the city 11 
X Ever Retained 
"1 am learning things in 
school that will help me 
get a good job in the 
future" 
"Once I have decided on 
a course of action I 
stick with it 11 
Number of subjects student 
feels he/she must master 
to reach career goals 
Prestige of Occupational 

Aspirations 
Rebellious Behavior in 
" chool 




.65 


.67 


.94 


.67 


.69 


1.01 


1 .98 


2.02 


.71 


1.82 


2.00 


3.38** 


.45 

• 


.43 


-.66 


.39 


.50 


U 53** 


3.30 


3.27 


-.76 


3.31 


3.33 


.38 


2.99 


3.03 


.81 


2.86 


3.12 


4.97** 


3.82 


3.83 


.20 


3.60 


3.96 


3.39** 


50.2 


50.2 


-.34 


50.4 


51.8 


1.51 


1.87 


1.90 


.83 


1.86 


1.83 


-.95 


1.89 


1.91 


1.07 


1.96 


1.89 


-2.72** 




1.85 


.25 


1 .86 


1.83 


-1.11 


.39 


.42 


1.04 


.34 


.42 


2.81** 



cademic Rewards 
Jance of School 
Z Sj^pended this Term 

fti — ■ — * — - — -.—^-^^^ 

i 

Note. Percentiles appear in parentheses next to mean scale scores. Percentiles are avai- 
lable only for Effective School Battery survey measures and other measures that were 
included in the normative sample for the Effective School Battery. 1983 means are bated 
on 790 and 732 student surveys and 37 and 39 teacher surveys from Calverton and Piml ico, 
respectively. 1984 means are based on 1160 and 824 student surveys and 57 and 62 teacher 
surveys from Calverton and Pimlico, respectively. 

a 

Alienation is "Social Integration "in the ESB with the scoring reversed (Social Integra- 
gion = 1 - Alienation). 

Negative Peer Influence is "Positive Peer Associations" in the ESB with the scoring 
reversed (Positive Peer Associations ■ 1 - Negative Peer Influence). 

This scale lacks one item that is included in the ESB scale by the same name. Normative 
data are not available. 

Format of involvement items on 1983 survey differed from that on the 1984 survey. Com- 
parisons are not meaningful. 

School Punishments is "Avoidance of School Punishments" on the ESB with the scoring 
reversed (Avoidance of School Punishments ' ------ 



1 - School Punishments). 



V.05 

**£<.01 
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Table D2 



1983-1984 Attendance, Achievement and Discipline 
Data from School Records 



Calverton Lemmeia Pimlico Greenspringa 



Enrollment 

Annual Attendance Rate 

Disciplinary Removals 
X students removed 
Number of removals/enrollment 

Spri n<Y » 1984 Mean Grade Equivalent, 
California Achievement Test, 
Reading Comprehension 

Grade 7 

Grade 8 

Grade 9 



1471 

77% (-2X) 



35.81 
64.6X 



(-3.5%) 
(-7.22) 



6.4 (+.1) 
8.0 (No change) 
8.7 (+.4) 



1199 
78% 



21 .9X 
29 .6% 



6.7 
8.0 
8.7 



(-1%) 



(-1.8X) 
(-7.7X) 



(+.4) 
(+.2) 

(+.3) 



1200 

7 9X <-2X) 



37.4% 
71.3% 



(+12.3X) 
(+29.5%) 



6.3 (No change) 
8.0 (No change) 

8.4 (-.1) 



1357 
76% 



40 .81 
70 .4% 



(-2Z) 



(+26.7%) 
(+52.9%) 



6.7 (+.4) 
8.2 U.3) 
8.7 (+.3) 



Note . All statistics were provided by the Office of Research and Evaluation, Baltimore City Public Schools. Num- 
bers in parentheses summarize change over the average of the preceding three years. 
> 

•Comparison schools. 

! 

< 

O 

u 

•4 
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School Safety fTeacnersj 

Calverton and Pimlico. 1983 & 198.4 




DS 

BEST COPY AVAILABLE 



Teacher Morale 

C.O'verion and Pirnlico, 1933 &. 1984 
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School Planning and- Action 

Calverton and Pimlico, 1983 & 1984 




■Year 

□ Pimlion * * t- Calvvrlon 
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BEST COPY AVAILABLE 



V) 
«*- 

l_ 

0 

a 

« 
X 

o 

0 

0 



1 .62 



1.6 - 



1.58 



1 .56 g Q.2 3 
1 .54 
1 .52 
1 .5 
1.48 
1 .46 
1 .44 



1.42 - 

1 .4 
1.38 



1.36 



--Gf^)3 



1983 



9 
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Smooth Administration 

Calverton and Pimlico, 1983 5c 1984 



-{]Q.24 



0.12 



1984 



u Pimlico 



Year 

+ Calverton * 



1)8 



BEST COW AVAILABLE 
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2.5 



2.4 - 



2.3 - 



2.2 - 



2.1 - 



2 - 



1 .9 



1983 



Resources 

Calverton and Plmllco, 1983 St 198-4 



u Plmllco 



BEST COPT AVAIL A 



Year 

+ Calverton 




1984 



1 .6 



&E31 CObA VAVirV\. 

Pace Relations 

C-J'verton and Pimlico. 1983 & 1984 



1.5 - 



i— 

O 

u 
LO 

c 

o 

.2 
a> 

0) 

o 
o 
a: 

c 
o 
a> 
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1.3 ~i 




1983 



91 111 iti.ll> m 



kst aw available 



i ^..ilvorU^ri * * 



1)10 



0.38 
•*0. 34 



1 984 



92 



Vi 

O 

a 
on 

o 
o 
« 



93 



1.42 



Parent ana- Community nvolvement 

Calverton and Plmllco, 1983 ii 1984 



1.4 
1.38 H 
1.36 
1.34 - 
1 .32 - 

1.3 
1.28 
1.26 - 
1.24 - 
1.22 - 

1.2 
1.18- 
1.16 - 
1.14- 
1.12 



tK ).35 



1983 



0.78 



410.35 



1984 



Plmllco 



Year 

+ 



Calverton 
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Student Influence 

Calverton and Pimlico, 1983 & 1984 
1 .55 -i 




1.15 
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